-- Logs begin at Fri 2021-05-28 13:23:33 UTC, end at Fri 2021-05-28 14:49:13 UTC. -- May 28 14:12:35.336696 dv-cinder-791281-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 28 14:12:35.348688 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 28 14:12:35 2021] *** May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: nodename: dv-cinder-791281-3-iscsi May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: machine: x86_64 May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: clock source: unix May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: pcre jit disabled May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: detected number of CPU cores: 4 May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: current working directory: / May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: detected binary path: /usr/bin/uwsgi-core May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: your processes number limit is 47680 May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: your memory page size is 4096 bytes May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: detected max file descriptor number: 2048 May 28 14:12:35.351453 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: lock engine: pthread robust mutexes May 28 14:12:35.352716 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: thunder lock: enabled May 28 14:12:35.352716 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 28 14:12:35.352716 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 28 14:12:35.394446 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: Python main interpreter initialized at 0x5619fffb89c0 May 28 14:12:35.394446 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: python threads support enabled May 28 14:12:35.394446 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: your server socket listen backlog is limited to 100 connections May 28 14:12:35.394446 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: your mercy for graceful operations on workers is 90 seconds May 28 14:12:35.394868 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: mapped 403077 bytes (393 KB) for 2 cores May 28 14:12:35.394868 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: *** Operational MODE: preforking *** May 28 14:12:35.395157 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: *** uWSGI is running in multiple interpreter mode *** May 28 14:12:35.395157 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: spawned uWSGI master process (pid: 91967) May 28 14:12:35.395375 dv-cinder-791281-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 28 14:12:35.397287 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: spawned uWSGI worker 1 (pid: 91968, cores: 1) May 28 14:12:35.397287 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: spawned uWSGI worker 2 (pid: 91969, cores: 1) May 28 14:12:35.397287 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 14:12:37.028080 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 14:12:37.028080 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: from cryptography.utils import int_from_bytes May 28 14:12:37.028760 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 14:12:37.028760 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: from cryptography.utils import int_from_bytes May 28 14:12:37.037614 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 14:12:37.037614 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: from cryptography.utils import int_from_bytes May 28 14:12:37.038254 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 14:12:37.038254 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: from cryptography.utils import int_from_bytes May 28 14:12:39.670992 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 14:12:39.671564 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 14:12:39.671751 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 14:12:39.672117 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 14:12:39.672376 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 14:12:39.672762 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.673121 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.673454 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.673780 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.674117 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.674434 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.674759 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.675082 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.675421 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.675709 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.675979 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 14:12:39.676360 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.676453 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 14:12:39.676539 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791281-3-iscsi {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.676656 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.676741 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 14:12:39.676965 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.677061 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 14:12:39.677279 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.677365 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 14:12:39.677598 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.677683 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.677908 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.678002 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.678235 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.678330 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.678545 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.678635 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.678943 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.679043 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.679260 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.679461 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.679611 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.679798 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.679933 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.680113 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.680260 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.680453 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.680552 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.680771 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.680864 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.681086 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.681170 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791281-3-iscsi {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.681408 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.681536 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.681720 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.681812 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.682045 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.682139 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.682383 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.682501 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.682878 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.682993 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791281-3-iscsi {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.683074 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.683141 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.683336 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.683571 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.683863 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.683994 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.684181 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.684406 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.684496 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.684743 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.684852 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.685098 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.685207 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.685434 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.685546 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.685756 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.685870 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.686074 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.686176 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.686392 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.686504 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.686718 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.686819 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.687037 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.687141 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.687358 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.687444 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791281-3-iscsi {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.687693 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.687784 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.688009 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.688128 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.688323 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.688432 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.688647 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.688796 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.688968 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.689130 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.689258 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.689418 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.689551 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.689734 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.689880 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.690060 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.690178 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.690374 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.690464 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.690706 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.690793 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.690987 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.691161 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.691243 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.691327 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.691591 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.691698 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.691898 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.692058 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.692215 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.692303 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.692529 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.692616 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.692842 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.692936 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.693154 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.693245 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.693467 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.693558 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.693737 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.693836 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.694049 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.694137 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.694373 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.694465 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.694695 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.694782 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.695013 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.695104 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.695273 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.695364 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.695530 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.695668 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.695877 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.695991 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.696208 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.696398 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.696660 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.696890 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.696977 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.697527 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.697606 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.697703 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.697808 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.697892 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.697958 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.698220 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.698348 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.698542 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.698715 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.698855 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.699219 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.699506 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.699886 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.700005 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.700180 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.700268 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.700342 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.700470 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.700553 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.700724 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.700943 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.701025 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.701377 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.701641 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.701641 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.701813 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.701944 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.702031 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.702256 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.702386 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.702570 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.702657 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.702875 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.702961 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.703188 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.703352 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.703500 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.703836 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.703922 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.704211 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.704332 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.704466 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.704596 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.704778 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.704913 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.705090 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.705226 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.705405 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.705546 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.705713 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.705874 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.706035 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.706205 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.706360 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.706513 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.706674 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.706767 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.706985 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.707077 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.707295 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.707381 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.707631 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.707733 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.707959 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.708053 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.708272 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.708359 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.708583 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.708669 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.708891 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.708975 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.709208 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.709309 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.709516 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.709604 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.709828 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.709921 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.710141 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.710228 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.710452 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.710542 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.710760 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.710858 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.711067 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.711157 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.711375 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.711465 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.711712 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.711822 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.712044 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.712138 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.712327 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.712420 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.712634 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.712775 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.712944 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.713030 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.713252 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.713347 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.713564 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.713666 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.713889 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.713975 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.714201 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.714329 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.714505 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.715100 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.715348 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.715436 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.715680 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.715784 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.715999 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.716100 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.716314 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.716413 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.716626 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.716724 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.716939 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.717036 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.717265 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.717359 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.717571 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.717658 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.717885 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.717973 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.718210 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.718314 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.718530 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.718630 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.718838 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.718927 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.719147 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.719234 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.719458 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.719545 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.719792 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.719884 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.720102 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.720190 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.720410 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.720506 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.720719 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.720806 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.721024 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.721117 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.721345 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.721441 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.721672 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.721767 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.721985 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.722073 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.722300 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.722396 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.722616 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.722740 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.722937 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:12:39.723037 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.723264 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.723364 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.723611 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.723703 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.723947 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.724046 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.724277 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.724375 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.724599 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.724695 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.724947 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.725040 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.725298 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.725398 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.725617 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.725706 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.725947 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.726034 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.726263 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.726357 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.726588 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.726698 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.726905 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.726999 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.727222 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.727318 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.727542 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.727654 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.727886 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.727976 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.728205 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.728304 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.728526 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.728686 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.728829 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.728974 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.729156 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.729295 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.729478 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.729575 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.729788 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.729918 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.730102 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.730930 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.731095 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.731228 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.731371 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.731520 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.731633 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.731713 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.731952 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.732038 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.732285 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.732391 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.732598 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.732698 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.732941 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.733078 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.733252 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.733351 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.733567 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.733660 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.733885 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.733971 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.734197 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.734296 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.734516 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.734602 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.734830 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.734914 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.735147 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.735241 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.735471 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.735575 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.735813 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.735910 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.736189 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.736290 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.736446 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.736566 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.736759 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.736846 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.737070 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.737158 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.737384 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.737471 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.737696 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.737783 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.738013 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.738107 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.738336 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.738430 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.738651 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.738754 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.738975 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.739070 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.739289 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.739380 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.739629 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.739731 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.739949 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.740034 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.740260 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.740358 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.740582 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.740680 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.740900 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.740993 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.741215 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.741302 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.741525 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.741619 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.741843 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.741929 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.742155 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.742239 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.742463 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.742555 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.742776 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.742868 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.743085 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.743177 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.743394 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.743567 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.743732 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.743868 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.744045 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.744244 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.744339 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.744651 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.744737 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.744980 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.745114 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.745300 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.745505 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.745613 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.745872 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.745962 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.746216 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.746302 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.746558 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.746651 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.746873 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.747017 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.747207 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.747292 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.747530 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.747709 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.747878 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.747964 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.748193 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.748287 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.748509 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.748593 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.748821 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.748911 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.749134 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.749226 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.749443 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.749528 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.749760 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.749858 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.750071 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.750168 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.750379 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.750464 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.750690 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.750781 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.750999 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.751091 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.751314 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.751408 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.751663 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.751753 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.751982 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.752082 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.752298 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.752384 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.752609 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.752701 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.752923 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.753009 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.753259 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.753342 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.753573 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.753703 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.753885 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.753971 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.754197 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.754282 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.754514 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.754606 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.754839 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.754935 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.755159 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.755245 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.755472 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.755589 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.755808 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.755895 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.756127 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.756219 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.756439 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.756524 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.756751 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.756845 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.757062 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.757148 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.757373 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.757465 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.757690 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.757777 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.758008 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.758099 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.758338 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.758432 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.758652 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.758736 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.758964 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.759061 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.759273 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.759369 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.759612 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.759706 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.759930 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.760014 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.760244 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.760343 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.760554 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.760639 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.760863 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.760948 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.761182 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.761276 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.762033 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.762147 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.762391 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.762484 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.762709 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.762797 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.763021 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.763113 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.763336 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.763421 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.763680 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.763768 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.763996 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.764157 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.764296 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.764427 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.764611 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.764742 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.764930 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.765018 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.765245 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.765331 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.765571 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.765666 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.765890 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.765983 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.766202 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.766295 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.766515 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.766601 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.766839 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.766924 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.767152 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.767249 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.767466 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.767580 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.767800 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.767886 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.768108 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.768204 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.768427 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.768512 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.768750 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.768842 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.769060 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.769332 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.769421 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.769673 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.769760 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.769992 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.770078 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.770314 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.770401 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.770633 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.770789 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.770947 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.771091 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.771275 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.771405 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.771622 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.771779 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.771928 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.772070 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.772239 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.772388 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.772556 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.772690 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.772870 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.773012 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.773180 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.773314 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.773501 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.773629 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.773812 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.773986 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.774122 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.774218 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.774433 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.774521 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.774743 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.774849 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.775054 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.775154 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.775360 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.775448 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.775701 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.775955 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.776046 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.776301 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.776394 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.776625 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.776727 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.776950 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.777039 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.777845 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.777947 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.778172 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.778274 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.778510 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.778599 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.778821 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.778907 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.779131 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.779220 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.779444 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.779531 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.779786 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.779873 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.780101 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.780192 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.780415 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.780503 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.780734 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.780822 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.781047 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.781136 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.781363 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.781464 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.781673 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.781761 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.781991 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.782084 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.782301 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.782388 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.782615 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.782712 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.782926 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.783023 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.783239 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.783338 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.783587 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.783704 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.783892 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.783980 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.784210 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.784311 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.784523 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.784625 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.784836 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.784936 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.785149 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.785256 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.785456 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.785550 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.785766 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.785855 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.786078 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.786165 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.786388 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.786475 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.786698 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.786796 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.787008 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.787096 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.787321 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.787415 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.787734 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.787843 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.788048 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.788144 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.788357 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.788446 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.788681 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.788769 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.788991 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.789084 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.789302 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.789396 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.789612 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.789708 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.789922 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.790025 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.790236 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.790337 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.790565 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.790654 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.790886 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.790973 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.791195 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.791311 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.791607 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.791719 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.791870 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.792024 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.792181 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.792457 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.792558 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.792816 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.792911 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.793128 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.793356 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.793458 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.793732 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.793822 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.794041 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.794174 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.794352 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.794605 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.794767 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.794981 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.795080 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.795296 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.796001 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.796129 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.796439 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.796527 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.796791 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.796885 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.797100 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.797197 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.797410 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.797513 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.797728 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.797816 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.798065 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.798165 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.798382 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.798468 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.798696 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.798836 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.799171 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.799279 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.799495 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.799604 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.799831 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.799928 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.800150 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.800318 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.800465 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.800553 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.800776 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.800864 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.801084 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.801181 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.801399 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.801501 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.801706 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.801794 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.802016 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.802105 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.802326 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.802413 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.802640 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.802734 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.802949 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.803095 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.803278 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.803368 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.803609 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.803703 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.803923 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.804019 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.804234 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.804324 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.804547 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.804633 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.804864 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.804953 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.805180 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.805268 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.805503 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.805614 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.805823 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.805953 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.806162 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.806411 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.806576 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.806739 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.806888 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.807041 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.807201 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.807347 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.807494 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.807682 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.807831 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.807987 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.808247 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.811179 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.811366 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.811366 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.811764 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.811764 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.812063 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.812234 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.812234 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.812533 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.812682 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.812828 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.812974 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.813120 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.813276 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.813423 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.813589 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.813739 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.813903 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.814067 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.814225 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.814889 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.814976 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815056 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815142 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815231 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815319 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815405 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815529 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815672 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815757 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815849 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.815938 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816024 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816111 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816190 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816267 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816357 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816438 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816516 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816593 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816690 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816782 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816851 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816916 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.816993 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817070 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817142 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817222 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817302 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817380 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817463 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817543 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817620 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817715 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817801 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817880 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.817958 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.818042 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.818128 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.818320 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.818416 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.818676 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.818774 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.818990 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.819079 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.819340 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.819428 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.819800 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.819893 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.820124 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.820264 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.820442 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.820539 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.820763 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.820865 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.821086 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.821195 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.821412 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.821515 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.821720 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.821825 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.822038 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.822160 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.822353 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.822451 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.822683 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.822778 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.823013 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.823114 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.823332 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.823421 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.823679 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.823782 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.824020 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.824115 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.824349 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.824442 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.824677 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.824763 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.824989 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.825076 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.825303 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.825390 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.825615 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.825725 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.825946 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.826064 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.826268 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.826382 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.826599 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.826694 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.827013 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.827101 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.827326 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.827414 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.827662 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.827769 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.827987 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.828089 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.828299 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.828396 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.828614 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.828714 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.828940 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.829036 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.829253 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.829384 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.829572 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.829677 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.829892 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.829980 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.830205 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.830300 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.830519 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.830710 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.830828 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.830918 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.831157 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.831247 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.831468 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.831586 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.831831 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.831920 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.832142 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.832240 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.832467 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.832556 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.832792 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.832886 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.833101 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.833197 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.833431 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.833535 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.833746 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.833840 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.834060 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.834172 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.834369 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.834494 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.834681 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.834826 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.835031 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.835158 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.835343 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.835474 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.835693 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.835810 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.836036 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.836135 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.836439 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.836542 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.836691 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.836781 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.837033 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.837130 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.837352 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.837439 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.837673 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.837767 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.837994 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.838089 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.838309 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.838398 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.838619 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.838713 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.838928 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.839027 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.839241 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.839337 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.839616 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.839717 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.839954 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.840056 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.840268 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.840362 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.840585 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.840820 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.840921 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.841188 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.841321 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.841497 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.841677 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.841813 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.842015 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.842233 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.842383 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.842520 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.842654 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.842789 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.842924 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.843080 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.843230 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.843372 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.843601 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.843740 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.843920 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.844060 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.844249 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.844389 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.844587 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.844727 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.844917 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.845064 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.845227 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.845361 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.845629 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.845719 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.845948 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.846083 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.846281 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.846421 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.846606 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.846739 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.846932 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.847079 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.847235 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.847381 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.847541 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.847730 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.847867 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.848013 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.848183 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.848324 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.848496 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.848635 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.848810 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.848982 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.849117 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.849272 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.849411 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.849556 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.849719 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.849863 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.850031 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.850299 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.850445 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.850641 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.850799 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.850944 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.851079 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.851265 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.851415 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.851606 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.851755 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.851937 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.852073 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.852259 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.852398 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.852578 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.852721 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.852899 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.853032 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.853217 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.853357 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.853535 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.853684 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.853868 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.853966 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.854198 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.854285 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.854514 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.854603 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.854849 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.854947 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.855200 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.855868 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.856096 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.856195 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.856450 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.856551 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.856746 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.856837 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.857113 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.857207 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.857443 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.857531 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.857758 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.857859 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.858077 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.858173 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.858401 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.858487 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.858724 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.858820 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.859046 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.859140 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.859369 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.859625 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.859730 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.860023 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.860122 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.860343 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.860439 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.860659 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.860781 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.860979 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.861204 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.861292 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.861620 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.861720 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.862048 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.862144 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.862378 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.862519 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.862697 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.862957 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.863056 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.863333 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.863427 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.863852 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.863946 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.864208 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.864297 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.864551 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.864751 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.864884 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.865218 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.865333 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.865606 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.865695 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.865933 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.866019 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.866264 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.866414 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.866567 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.866700 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.866875 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.867017 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.867193 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.867341 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.867509 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.867688 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.867846 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.867979 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.868172 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.868307 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.868490 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.868626 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.868802 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.868935 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.869127 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.869261 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.869442 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.869575 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.869815 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.869979 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.870144 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.870332 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.870466 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.870654 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.870814 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.871610 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.871771 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.871996 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.872147 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.872289 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.872473 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.872652 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.872794 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.872936 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.873112 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.873247 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.873436 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.873647 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.873784 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.873917 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.874068 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.874202 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.874382 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.874593 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.874735 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.874917 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.875052 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.875259 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.875406 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.875605 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.875741 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.875922 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.876066 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.876222 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.876369 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.876556 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.876690 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.876867 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.877001 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.877176 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.877322 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.877483 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.877626 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.877799 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.877944 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.878096 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.878252 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.878403 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.878546 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.878701 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.878834 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.878994 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.879133 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.879317 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.879453 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.879651 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.879787 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.879949 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.880101 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.880236 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.880510 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.880644 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.880856 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.881001 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.881177 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.881322 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.881486 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.881646 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.881814 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.881958 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.882111 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.882260 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.882416 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.882550 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.882730 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.882873 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.883047 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.883182 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.883358 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.883491 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.883694 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.883846 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.884043 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.884188 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.884336 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.884473 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.884619 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.884754 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.884931 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.885248 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.885417 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.885562 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.885760 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.885899 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.886093 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.886238 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.886464 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.886600 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.886814 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.886955 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.887129 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.887262 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.887441 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.887617 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.887787 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.887921 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.888115 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.888249 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.888426 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.888585 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.888726 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.888869 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.889041 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.889174 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.889354 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.889498 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.889667 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.889805 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.889981 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.890113 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.890294 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.890439 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.890605 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.890738 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.890916 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.891057 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.891235 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.891371 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.891578 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.891685 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.891901 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.892049 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.892217 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.892358 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.892531 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.892680 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.892857 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.892996 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.893175 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.893315 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.893491 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.893635 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.893809 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.893955 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.894127 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.894272 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.894451 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.894596 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.894786 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.894939 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.895106 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.895418 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.895586 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.895874 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.896008 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.896201 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.896350 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.896525 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.896625 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.896851 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.896999 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.897150 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.897289 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.897500 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.897633 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.897816 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.897955 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.898146 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.898285 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.898477 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.898614 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.898778 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.898878 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.899091 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.899230 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.899399 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.899536 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.899740 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.899843 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.900062 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.900151 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.900382 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.900472 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.900701 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.900799 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.901020 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.901108 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.901337 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.901432 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.901676 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.901772 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.902005 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.902129 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.902370 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.902464 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.902700 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.902790 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.903029 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.903149 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.903346 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.903441 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.903689 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.903792 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.904011 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.904098 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.904326 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.904415 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.904651 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.904740 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.904968 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.905057 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.905299 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.905387 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.905611 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.905699 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.905929 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.906043 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.906251 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.906372 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.906576 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.906717 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.906914 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.907050 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.907240 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.907499 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.907719 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.907929 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.908115 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.908233 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.908526 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.908731 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.908824 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.908906 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.909140 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.909235 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.909455 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.909570 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.909767 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.909931 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.910080 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.910184 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.910400 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.910499 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.910715 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.910802 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.911036 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.911131 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.911355 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.911526 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.911699 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.911798 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.912019 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.912134 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.912349 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.912457 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.912678 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.912767 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.912988 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.913077 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.913312 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.913402 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.913634 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.913722 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.913963 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.914075 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.914280 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.914377 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.914597 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.914686 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.914919 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.915016 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.915236 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.915325 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.915578 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.915672 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.915898 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.916001 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.916218 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.916313 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.916610 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.916720 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.916853 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.916951 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.917179 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.917269 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.917510 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.917600 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.918364 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.918456 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.918696 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.918784 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.919014 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.919101 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.919353 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.919493 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.919691 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.919810 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.920023 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.920126 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.920353 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=91969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 14:12:39.920463 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.920677 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.921040 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.921335 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.921656 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.921976 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.922299 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.922616 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.922936 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.923283 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.923643 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.923978 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.924296 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.924627 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.924955 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.925286 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.925613 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.925935 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.926275 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.926596 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.926927 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.927249 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.927585 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.927917 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.928245 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.928582 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.928917 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.929252 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.929586 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.929941 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.930265 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.930616 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.930952 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:12:39.931201 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=91968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 14:12:39.956071 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG oslo_db.sqlalchemy.engines [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:12:39.966285 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:12:40.201871 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.context [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af7bb5ca-612d-46a1-a71f-5077f87c311e(cell1) {{(pid=91969) load_cells /opt/stack/nova/nova/context.py:464}} May 28 14:12:40.206121 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG oslo_concurrency.lockutils [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=91969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:40.207827 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG oslo_concurrency.lockutils [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=91969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:40.208665 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG oslo_concurrency.lockutils [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=91969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:40.210668 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG oslo_concurrency.lockutils [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=91969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:40.215126 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.context [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af7bb5ca-612d-46a1-a71f-5077f87c311e(cell1) {{(pid=91968) load_cells /opt/stack/nova/nova/context.py:464}} May 28 14:12:40.219476 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:40.221228 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:40.222072 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:40.224169 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:40.236491 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG oslo_db.sqlalchemy.engines [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:12:40.237308 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG oslo_db.sqlalchemy.engines [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:12:40.253308 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:12:40.254350 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:12:40.268292 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG oslo_db.sqlalchemy.engines [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:12:40.288599 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:12:40.835938 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: WARNING keystonemiddleware.auth_token [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 14:12:40.842612 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: WARNING keystonemiddleware.auth_token [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 14:12:40.907603 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: WARNING keystonemiddleware.auth_token [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 14:12:40.914461 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: WARNING keystonemiddleware.auth_token [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 14:12:41.074381 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: WARNING keystonemiddleware.auth_token [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 14:12:41.080016 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: WARNING keystonemiddleware.auth_token [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 14:12:41.085313 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619fffb89c0 pid: 91969 (default app) May 28 14:12:41.087498 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:12:41.088642 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001706 May 28 14:12:41.089044 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 789 bytes} [Fri May 28 14:12:41 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:12:41.145635 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: WARNING keystonemiddleware.auth_token [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 14:12:41.150895 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: WARNING keystonemiddleware.auth_token [None req-cb8d37f0-71f8-4ae5-8a33-9564a500ee5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 14:12:41.156276 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619fffb89c0 pid: 91968 (default app) May 28 14:14:06.068208 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:06.069165 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 May 28 14:14:06.069757 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:14:06.659910 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-5d36d954-5c9c-4d81-aa9b-ac56c61b7c2e admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:06.688255 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-5d36d954-5c9c-4d81-aa9b-ac56c61b7c2e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.610603 May 28 14:14:06.688805 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1291 bytes} [Fri May 28 14:14:06 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:14:08.839944 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:08.840971 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-be71511b-6d6b-415c-b283-02548b1eb637 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 28 14:14:08.841381 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:08.900259 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-2bac9b37-a8c5-47ed-b948-2c5229f2fff0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:08.919361 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:14:08.919361 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: warnings.warn(msg) May 28 14:14:09.059107 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-2bac9b37-a8c5-47ed-b948-2c5229f2fff0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.211550 May 28 14:14:09.060009 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:08 2021] POST /compute/v2.1/flavors => generated 407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:14:09.415200 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-cb95c010-cfff-4e4a-b3bc-1546fec5bd5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:09.418724 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:14:09.418724 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: warnings.warn(msg) May 28 14:14:09.521073 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-cb95c010-cfff-4e4a-b3bc-1546fec5bd5b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.453268 May 28 14:14:09.538889 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1335 bytes} [Fri May 28 14:14:09 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:14:11.760927 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-2bac9b37-a8c5-47ed-b948-2c5229f2fff0 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:11.762503 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-2bac9b37-a8c5-47ed-b948-2c5229f2fff0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 May 28 14:14:11.763227 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:11 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:11.892021 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-785fc3ac-be42-4eaf-a7a1-4e72e7e29b01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "ram": 512}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:11.915328 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:14:11.915328 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: warnings.warn(msg) May 28 14:14:12.049234 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-785fc3ac-be42-4eaf-a7a1-4e72e7e29b01 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.277267 May 28 14:14:12.049865 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:14:12.062778 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-37135820-eea8-41e8-a112-cb2853d19dd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:12.064363 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:14:12.064363 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: warnings.warn(msg) May 28 14:14:12.182954 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-37135820-eea8-41e8-a112-cb2853d19dd0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124236 May 28 14:14:12.183566 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1335 bytes} [Fri May 28 14:14:12 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:14:14.361247 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-785fc3ac-be42-4eaf-a7a1-4e72e7e29b01 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:14.362279 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-785fc3ac-be42-4eaf-a7a1-4e72e7e29b01 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 28 14:14:14.362686 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:14.423313 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-3fab3bf3-5cbe-4284-a4b6-c08011e3b492 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "ram": 1024, "disk": 10}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:14.524235 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-3fab3bf3-5cbe-4284-a4b6-c08011e3b492 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155393 May 28 14:14:14.525377 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:14:14.537831 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-a261dcf5-2562-4e8d-b183-35be9062cf70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:14.641917 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-a261dcf5-2562-4e8d-b183-35be9062cf70 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108391 May 28 14:14:14.647587 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1335 bytes} [Fri May 28 14:14:14 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:14:16.837071 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-3fab3bf3-5cbe-4284-a4b6-c08011e3b492 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:16.838255 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-3fab3bf3-5cbe-4284-a4b6-c08011e3b492 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 May 28 14:14:16.838748 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:16.901907 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-b6cacc27-98c4-42dc-b62d-8cd08c41be89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:17.019739 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-b6cacc27-98c4-42dc-b62d-8cd08c41be89 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.174901 May 28 14:14:17.020309 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:14:17.032385 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-8118b91e-4696-49a9-8440-07fc89242f14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:17.171706 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-8118b91e-4696-49a9-8440-07fc89242f14 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126428 May 28 14:14:17.171706 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1335 bytes} [Fri May 28 14:14:17 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:14:19.316677 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-b6cacc27-98c4-42dc-b62d-8cd08c41be89 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:19.317681 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-b6cacc27-98c4-42dc-b62d-8cd08c41be89 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 28 14:14:19.319666 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:19.378458 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-d7e009f0-7ef5-482a-8335-55f9d3a3abd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "name": "ds4G"}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:19.489251 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-d7e009f0-7ef5-482a-8335-55f9d3a3abd9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164741 May 28 14:14:19.489941 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:14:19.504005 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-5ca415f9-6965-4735-94b4-ada96dbd6c08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:19.617601 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-5ca415f9-6965-4735-94b4-ada96dbd6c08 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117616 May 28 14:14:19.628090 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1335 bytes} [Fri May 28 14:14:19 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:14:21.802852 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-d7e009f0-7ef5-482a-8335-55f9d3a3abd9 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:21.804016 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-d7e009f0-7ef5-482a-8335-55f9d3a3abd9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 28 14:14:21.804422 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:14:21.899074 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-6ad601f7-48a5-4bc1-af96-e07a625c2c66 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:21.926411 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-6ad601f7-48a5-4bc1-af96-e07a625c2c66 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.111810 May 28 14:14:21.926957 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1291 bytes} [Fri May 28 14:14:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:14:24.093675 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-d7e009f0-7ef5-482a-8335-55f9d3a3abd9 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:24.094906 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-d7e009f0-7ef5-482a-8335-55f9d3a3abd9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 May 28 14:14:24.095484 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:24.163766 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-87496892-4ff8-4e23-8db1-e8374d366f95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "id": "1", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:24.252992 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-87496892-4ff8-4e23-8db1-e8374d366f95 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.151322 May 28 14:14:24.253549 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:24 2021] POST /compute/v2.1/flavors => generated 402 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:14:24.265730 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-c84335e1-b094-4c2d-b13b-6fdbf75c0469 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:24.369521 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-c84335e1-b094-4c2d-b13b-6fdbf75c0469 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107119 May 28 14:14:24.370222 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1332 bytes} [Fri May 28 14:14:24 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:14:26.622149 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-87496892-4ff8-4e23-8db1-e8374d366f95 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:26.623145 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-87496892-4ff8-4e23-8db1-e8374d366f95 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 28 14:14:26.623609 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:26.704125 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-c48bb7f2-7a73-480b-9724-f1492e87ac83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "swap": 0, "id": "2", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:26.811723 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-c48bb7f2-7a73-480b-9724-f1492e87ac83 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.181661 May 28 14:14:26.812759 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:14:26.825147 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-a1d7da4b-648f-4cf2-bc08-77bcfb40d638 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:26.931230 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-a1d7da4b-648f-4cf2-bc08-77bcfb40d638 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110445 May 28 14:14:26.931869 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1332 bytes} [Fri May 28 14:14:26 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:14:29.077850 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-c48bb7f2-7a73-480b-9724-f1492e87ac83 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:29.078788 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-c48bb7f2-7a73-480b-9724-f1492e87ac83 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 28 14:14:29.079198 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:29.137176 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-031af22f-f301-4b81-83cc-35e47cd83d7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "id": "3", "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:29.219219 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-031af22f-f301-4b81-83cc-35e47cd83d7f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.134001 May 28 14:14:29.219813 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:29 2021] POST /compute/v2.1/flavors => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:14:29.232473 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-4470d2fc-7a47-4baf-80f0-e1161bb83386 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:29.335262 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-4470d2fc-7a47-4baf-80f0-e1161bb83386 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106579 May 28 14:14:29.335804 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1332 bytes} [Fri May 28 14:14:29 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:14:31.503030 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-031af22f-f301-4b81-83cc-35e47cd83d7f admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:31.504082 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-031af22f-f301-4b81-83cc-35e47cd83d7f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 28 14:14:31.504512 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:31.564905 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-1083878e-c95f-4f8e-9bb0-726765288076 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:31.652959 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-1083878e-c95f-4f8e-9bb0-726765288076 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142018 May 28 14:14:31.653851 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:14:31.665575 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-c09558c7-377e-4338-986d-ee57d3950d0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:31.777447 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-c09558c7-377e-4338-986d-ee57d3950d0f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115599 May 28 14:14:31.779697 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1332 bytes} [Fri May 28 14:14:31 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:14:33.924939 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-1083878e-c95f-4f8e-9bb0-726765288076 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:14:33.925993 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-1083878e-c95f-4f8e-9bb0-726765288076 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 May 28 14:14:33.926408 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:14:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:14:33.990641 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-d48786c8-1f76-4436-a52c-7dd9582eb76f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 160}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:34.110035 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-d48786c8-1f76-4436-a52c-7dd9582eb76f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.176957 May 28 14:14:34.110563 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1282 bytes} [Fri May 28 14:14:33 2021] POST /compute/v2.1/flavors => generated 408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:14:34.122628 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-819b2bfa-fa16-4411-8369-0d0658d07b7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:14:34.217831 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-819b2bfa-fa16-4411-8369-0d0658d07b7b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099443 May 28 14:14:34.231753 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1332 bytes} [Fri May 28 14:14:34 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:15:14.780412 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-d48786c8-1f76-4436-a52c-7dd9582eb76f admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:14.781428 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-d48786c8-1f76-4436-a52c-7dd9582eb76f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 28 14:15:14.781878 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 930 bytes} [Fri May 28 14:15:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:15:14.839691 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-4e6cc982-f9a2-4c8c-b8c0-310cd8911703 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:14.862874 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-4e6cc982-f9a2-4c8c-b8c0-310cd8911703 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075086 May 28 14:15:14.863416 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1291 bytes} [Fri May 28 14:15:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:15:16.243260 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-d48786c8-1f76-4436-a52c-7dd9582eb76f admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:16.244291 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-d48786c8-1f76-4436-a52c-7dd9582eb76f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 28 14:15:16.244691 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:15:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:15:16.432169 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-39e755dc-b7fb-4b92-98a3-6850ff98ada4 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:16.445080 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.wsgi [None req-39e755dc-b7fb-4b92-98a3-6850ff98ada4 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 28 14:15:16.445662 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-39e755dc-b7fb-4b92-98a3-6850ff98ada4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=91968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:15:16.446465 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-39e755dc-b7fb-4b92-98a3-6850ff98ada4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.064755 May 28 14:15:16.446992 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1191 bytes} [Fri May 28 14:15:16 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 14:15:16.456433 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-58881150-2379-4ee4-889b-2b9f9d7bbd49 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:16.477500 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-58881150-2379-4ee4-889b-2b9f9d7bbd49 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024801 May 28 14:15:16.478045 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1211 bytes} [Fri May 28 14:15:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:15:16.488097 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-a00f41b2-e2b3-4412-934f-6e88ac52d7d7 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:16.508307 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-a00f41b2-e2b3-4412-934f-6e88ac52d7d7 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023806 May 28 14:15:16.508847 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1211 bytes} [Fri May 28 14:15:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:15:16.517759 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-e392ba48-e4e0-47d8-88ce-34f928f715eb admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:16.530523 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.wsgi [None req-e392ba48-e4e0-47d8-88ce-34f928f715eb admin admin] HTTP exception thrown: Flavor 42 could not be found. May 28 14:15:16.531110 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-e392ba48-e4e0-47d8-88ce-34f928f715eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=91969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:15:16.531945 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-e392ba48-e4e0-47d8-88ce-34f928f715eb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017678 May 28 14:15:16.532447 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1191 bytes} [Fri May 28 14:15:16 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 14:15:17.826757 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-a00f41b2-e2b3-4412-934f-6e88ac52d7d7 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:17.827815 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-a00f41b2-e2b3-4412-934f-6e88ac52d7d7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 28 14:15:17.828225 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:15:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:15:18.020675 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-a3c1ca48-0803-4f11-b287-96f62ecfc772 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:18.033396 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.wsgi [None req-a3c1ca48-0803-4f11-b287-96f62ecfc772 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 28 14:15:18.033927 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-a3c1ca48-0803-4f11-b287-96f62ecfc772 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=91969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:15:18.034732 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-a3c1ca48-0803-4f11-b287-96f62ecfc772 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.065507 May 28 14:15:18.035244 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1191 bytes} [Fri May 28 14:15:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 14:15:18.044506 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-ae3b8de3-89ff-4808-b89d-fda7e3c1d6f1 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:18.064642 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-ae3b8de3-89ff-4808-b89d-fda7e3c1d6f1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023697 May 28 14:15:18.065190 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1211 bytes} [Fri May 28 14:15:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:15:18.075737 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-b10ce109-7e64-4d76-a76a-21faf812a8fc admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:18.096533 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-b10ce109-7e64-4d76-a76a-21faf812a8fc admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024312 May 28 14:15:18.097071 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1211 bytes} [Fri May 28 14:15:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:15:18.106836 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-6f534eaa-33dd-41a4-8705-e335f09470ac admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:18.119225 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.wsgi [None req-6f534eaa-33dd-41a4-8705-e335f09470ac admin admin] HTTP exception thrown: Flavor 84 could not be found. May 28 14:15:18.119840 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-6f534eaa-33dd-41a4-8705-e335f09470ac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=91968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:15:18.120647 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-6f534eaa-33dd-41a4-8705-e335f09470ac admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017676 May 28 14:15:18.121159 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1191 bytes} [Fri May 28 14:15:18 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 14:15:19.435678 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-b10ce109-7e64-4d76-a76a-21faf812a8fc admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:19.436682 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-b10ce109-7e64-4d76-a76a-21faf812a8fc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 28 14:15:19.437079 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:15:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:15:19.625053 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-d5b7b075-82f9-4e20-9200-574ec75188b5 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:19.637657 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.wsgi [None req-d5b7b075-82f9-4e20-9200-574ec75188b5 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 28 14:15:19.638230 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-d5b7b075-82f9-4e20-9200-574ec75188b5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=91968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:15:19.639033 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-d5b7b075-82f9-4e20-9200-574ec75188b5 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.063866 May 28 14:15:19.639573 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1194 bytes} [Fri May 28 14:15:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 14:15:19.649372 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-2f8f184b-2e89-4c3f-a8a9-f14c14d39167 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:19.668895 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-2f8f184b-2e89-4c3f-a8a9-f14c14d39167 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023666 May 28 14:15:19.669445 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1211 bytes} [Fri May 28 14:15:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:15:19.679084 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:19.702096 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026624 May 28 14:15:19.702640 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1211 bytes} [Fri May 28 14:15:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:15:19.712485 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-49a2f5ae-c41b-4087-9f58-833749d1f154 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:19.724264 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.wsgi [None req-49a2f5ae-c41b-4087-9f58-833749d1f154 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 28 14:15:19.724827 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-49a2f5ae-c41b-4087-9f58-833749d1f154 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=91969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:15:19.725630 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-49a2f5ae-c41b-4087-9f58-833749d1f154 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017399 May 28 14:15:19.726119 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1194 bytes} [Fri May 28 14:15:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 14:15:21.053042 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:21.054049 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 28 14:15:21.054447 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:15:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:15:21.243174 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-f59dfc10-64b9-4177-8c28-9dba8ad9bd40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:15:21.362571 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-f59dfc10-64b9-4177-8c28-9dba8ad9bd40 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.170942 May 28 14:15:21.363110 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1236 bytes} [Fri May 28 14:15:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:15:22.667213 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:22.668258 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 28 14:15:22.668652 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:15:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:15:22.864791 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-d43d8026-3b83-4250-8ef5-0bb875d7a195 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:15:22.961218 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-d43d8026-3b83-4250-8ef5-0bb875d7a195 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.147269 May 28 14:15:22.961773 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1236 bytes} [Fri May 28 14:15:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:15:24.274914 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:24.275970 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 28 14:15:24.276367 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:15:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:15:24.467515 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-c6036fde-ce5c-4188-9028-f8028c84e7a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:15:24.556192 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-c6036fde-ce5c-4188-9028-f8028c84e7a7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.139120 May 28 14:15:24.556666 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1236 bytes} [Fri May 28 14:15:24 2021] POST /compute/v2.1/flavors => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:15:25.887021 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:25.888070 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 28 14:15:25.888472 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:15:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:15:26.077165 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-4729b0c3-f91d-45d7-bb67-3bafefcb9f22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:15:26.171666 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-4729b0c3-f91d-45d7-bb67-3bafefcb9f22 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.144809 May 28 14:15:26.172270 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1236 bytes} [Fri May 28 14:15:26 2021] POST /compute/v2.1/flavors => generated 409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:15:27.480433 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:27.481445 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 28 14:15:27.481851 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:15:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:15:27.672962 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-a78e633a-c419-4dfd-b883-a72a105fab01 admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:15:27.698524 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-a78e633a-c419-4dfd-b883-a72a105fab01 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076715 May 28 14:15:27.698986 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1203 bytes} [Fri May 28 14:15:27 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:16:11.817604 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:16:11.819209 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-0b616199-4d15-42d8-a89d-9ab0b757894c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 May 28 14:16:11.819758 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 31/63] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:16:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:16:12.011800 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-06e39409-4932-4110-b981-6706501387fe admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:16:12.037756 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-06e39409-4932-4110-b981-6706501387fe admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.081484 May 28 14:16:12.038230 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1203 bytes} [Fri May 28 14:16:11 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:17:45.772954 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-cf68fb25-c274-4d04-bd8f-be4fedfd710f tempest-verify_tempest_config-1172283664 tempest-verify_tempest_config-1172283664-project] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:17:45.779290 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-cf68fb25-c274-4d04-bd8f-be4fedfd710f tempest-verify_tempest_config-1172283664 tempest-verify_tempest_config-1172283664-project] 10.222.0.59 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.115289 May 28 14:17:45.779290 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 32/65] 10.222.0.59 () {58 vars in 1134 bytes} [Fri May 28 14:17:45 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:19:24.129437 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-06e39409-4932-4110-b981-6706501387fe admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:19:24.130556 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-06e39409-4932-4110-b981-6706501387fe admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 May 28 14:19:24.131028 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 34/66] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:19:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:19:24.390748 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-685b44a1-1f36-402b-8d49-9ba0221599e8 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:19:24.391985 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:19:24.391985 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: warnings.warn(msg) May 28 14:19:24.393613 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-685b44a1-1f36-402b-8d49-9ba0221599e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:19:24.394104 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-685b44a1-1f36-402b-8d49-9ba0221599e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:19:24.395458 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-685b44a1-1f36-402b-8d49-9ba0221599e8 admin admin] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:19:24.396007 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-685b44a1-1f36-402b-8d49-9ba0221599e8 admin admin] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:19:24.433790 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-685b44a1-1f36-402b-8d49-9ba0221599e8 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.164586 May 28 14:19:24.434637 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1194 bytes} [Fri May 28 14:19:24 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:19:25.754978 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: DEBUG nova.api.openstack.wsgi [None req-06e39409-4932-4110-b981-6706501387fe admin admin] Calling method '>' {{(pid=91969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:19:25.756024 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: INFO nova.api.openstack.requestlog [None req-06e39409-4932-4110-b981-6706501387fe admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 28 14:19:25.756428 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: [pid: 91969|app: 0|req: 35/68] 10.222.0.59 () {56 vars in 1075 bytes} [Fri May 28 14:19:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:19:25.944198 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG nova.api.openstack.wsgi [None req-5e2dbc4c-2580-4d52-bc71-d845df8d6979 admin admin] Calling method '>' {{(pid=91968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:19:25.945362 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:19:25.945362 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: warnings.warn(msg) May 28 14:19:25.946966 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-5e2dbc4c-2580-4d52-bc71-d845df8d6979 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:19:25.947416 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-5e2dbc4c-2580-4d52-bc71-d845df8d6979 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:19:25.948267 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-5e2dbc4c-2580-4d52-bc71-d845df8d6979 admin admin] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:19:25.948709 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: DEBUG oslo_concurrency.lockutils [None req-5e2dbc4c-2580-4d52-bc71-d845df8d6979 admin admin] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=91968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:19:25.974877 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: INFO nova.api.openstack.requestlog [None req-5e2dbc4c-2580-4d52-bc71-d845df8d6979 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.081539 May 28 14:19:25.975366 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: [pid: 91968|app: 0|req: 34/69] 10.222.0.59 () {60 vars in 1194 bytes} [Fri May 28 14:19:25 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:20:23.426982 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: Fri May 28 14:20:23 2021 - graceful shutdown triggered... May 28 14:20:23.427505 dv-cinder-791281-3-iscsi devstack@n-api.service[91968]: Gracefully killing worker 1 (pid: 91968)... May 28 14:20:23.427919 dv-cinder-791281-3-iscsi devstack@n-api.service[91969]: Gracefully killing worker 2 (pid: 91969)... May 28 14:20:23.429168 dv-cinder-791281-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 28 14:20:24.428127 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: worker 1 buried after 1 seconds May 28 14:20:24.428127 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: worker 2 buried after 1 seconds May 28 14:20:24.428127 dv-cinder-791281-3-iscsi devstack@n-api.service[91967]: goodbye to uWSGI. May 28 14:20:24.430252 dv-cinder-791281-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 28 14:20:24.430821 dv-cinder-791281-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 28 14:20:24.433779 dv-cinder-791281-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 28 14:20:24.444476 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 28 14:20:24 2021] *** May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: nodename: dv-cinder-791281-3-iscsi May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: machine: x86_64 May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: clock source: unix May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: pcre jit disabled May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: detected number of CPU cores: 4 May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: current working directory: / May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: detected binary path: /usr/bin/uwsgi-core May 28 14:20:24.446493 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: your processes number limit is 47680 May 28 14:20:24.447222 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: your memory page size is 4096 bytes May 28 14:20:24.447222 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: detected max file descriptor number: 2048 May 28 14:20:24.447222 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: lock engine: pthread robust mutexes May 28 14:20:24.447222 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: thunder lock: enabled May 28 14:20:24.447222 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 28 14:20:24.447222 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 28 14:20:24.488833 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: Python main interpreter initialized at 0x55a2b5fb89c0 May 28 14:20:24.488833 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: python threads support enabled May 28 14:20:24.488833 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: your server socket listen backlog is limited to 100 connections May 28 14:20:24.488833 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: your mercy for graceful operations on workers is 90 seconds May 28 14:20:24.489272 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: mapped 403077 bytes (393 KB) for 2 cores May 28 14:20:24.489272 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: *** Operational MODE: preforking *** May 28 14:20:24.489578 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: *** uWSGI is running in multiple interpreter mode *** May 28 14:20:24.489578 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: spawned uWSGI master process (pid: 106796) May 28 14:20:24.489807 dv-cinder-791281-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 28 14:20:24.491591 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: spawned uWSGI worker 1 (pid: 106811, cores: 1) May 28 14:20:24.491591 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: spawned uWSGI worker 2 (pid: 106812, cores: 1) May 28 14:20:24.492970 dv-cinder-791281-3-iscsi devstack@n-api.service[106796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 14:20:26.270329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 14:20:26.270329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: from cryptography.utils import int_from_bytes May 28 14:20:26.271016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 14:20:26.271016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: from cryptography.utils import int_from_bytes May 28 14:20:26.273918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 14:20:26.273918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: from cryptography.utils import int_from_bytes May 28 14:20:26.274421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 14:20:26.274421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: from cryptography.utils import int_from_bytes May 28 14:20:28.720763 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 14:20:28.721407 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 14:20:28.721517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 14:20:28.721862 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 14:20:28.722129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 14:20:28.722528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.722887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.723218 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.723539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.723909 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.724234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.724570 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.724901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.725244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.725517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.725850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.726243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791281-3-iscsi {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.726550 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.726871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.727196 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.727527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.727872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.728209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.728528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.729043 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.729494 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.729825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.730152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.730506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.730838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.731157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.731492 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.731847 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.732189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.732508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.732919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791281-3-iscsi {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.733247 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.733577 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.733903 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.734360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.734654 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.734974 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.735308 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.735673 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.736016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.736344 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.736680 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.737015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.737608 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.737929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.738254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.738491 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 14:20:28.738877 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.738985 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 14:20:28.739060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.739247 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.739354 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 14:20:28.739524 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.739684 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 14:20:28.739843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.739949 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 14:20:28.740134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.740309 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.740489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.740647 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.740824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.740925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.741136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.741267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.741439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.741602 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.741703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.742446 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.742606 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.742754 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.742908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.743064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.743216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.743374 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.743527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.743711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.743874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.744052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.744200 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.744376 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791281-3-iscsi {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.744523 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.744666 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.744816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.744964 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.745109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.745266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.745442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.745596 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.745740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.745891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.746035 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.746193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.746359 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.746513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.746664 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.746961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.747145 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.747329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.747491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.747692 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.747842 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.747993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.748152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.748325 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.748480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.748626 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.748781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.748926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.749079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.749233 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.749402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.749566 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.749720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.749875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.750028 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.750181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.750345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.750492 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.750647 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791281-3-iscsi {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.750804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.750959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.751104 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.751249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.751392 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.751547 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.751733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.751890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.752043 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.752213 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.752376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.752536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.752683 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.753842 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754112 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754205 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754291 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754431 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754515 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.754925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755088 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755170 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755492 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755604 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755880 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.755970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.756068 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.756194 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.756370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.756560 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.756716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.756876 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.757222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.757438 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.758111 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.758268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.758421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.758582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.758736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.758894 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.759052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.759201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.759345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.759500 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.759707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.759871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.760040 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.760200 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.760369 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.760527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.760679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.760848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.761003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.761148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.761292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.761435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.761588 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.761742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.761896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.762049 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.762203 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.762347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.762491 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.762644 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.762807 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.762960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.763106 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.763250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.763401 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.763573 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.763724 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.763879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.764024 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.764176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.764330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.764490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.764643 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.764810 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.764963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.765115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.765289 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.765445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.765601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.765746 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.765905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.766059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.766230 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.766401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.766556 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.766701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.766870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.767023 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.767354 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.767516 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.767755 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.767901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.768057 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.768211 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.768372 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.768517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.768669 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.768823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.768995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.769150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.769303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.769462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.769608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.769759 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.769906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.770066 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.770219 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.770372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.770519 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.770519 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.770811 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.770979 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.771134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.771279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.771423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.771586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.771753 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.771913 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.772071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.772231 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.772382 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.772529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.772686 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.772840 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.773031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.773193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.773339 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.773494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.773648 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.773793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.773946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.774100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.774245 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.774407 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.774552 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.774706 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.774869 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.775014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.775157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.775321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.775474 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.775656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.775841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.775999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.776144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.776303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.776303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.776583 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.776744 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.776902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.777057 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.777203 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.777534 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.777699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.777848 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.778002 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.778147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.778291 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.778435 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.778655 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.778815 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.778969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.779134 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.779288 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.779441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.779629 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.779805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.779962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.780116 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.780261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.780411 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.780569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.780713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.780866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.781020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.781218 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.781379 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.781532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.781677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.781851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.782011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.782185 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.782381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.782531 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.782690 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.782842 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.782988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.783152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.783349 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.783520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.783705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.783880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.784032 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.784185 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.784330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.784488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.784641 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.784794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.784947 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 14:20:28.785102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.785273 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.785439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.785585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.785730 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.785730 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.786002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.786155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.786310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.786465 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.786619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.786765 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.786909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.787062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.787220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.787373 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.787721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.787897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.788049 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.788205 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.788360 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.788518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.788694 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.788850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.789004 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.789165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.789347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.789494 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.789647 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.789793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.789793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.790099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.790243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.790389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.790533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.790675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.790833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.790993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.791146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.791302 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.791447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.791651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.791814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.791961 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.792105 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.792280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.792437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.792608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.792777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.792926 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.793071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.793216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.793380 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.793380 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.793685 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.793831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.793975 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.794131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.794280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.794450 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.794601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.794753 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.794899 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.795051 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.795210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.795375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.795529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.795709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.795857 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.796025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.796182 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.796328 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.796491 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.796650 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.796806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.796960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.796960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.797263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.797425 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.797578 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.797909 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.798070 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.798070 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.798370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.798370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.798664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.798827 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.798983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.799150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.799305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.799471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.799706 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.799902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.800077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.800225 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.800370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.800556 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.800556 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.800844 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.801003 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.801149 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.801316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.801467 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.801633 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.801787 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.802010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.802158 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.802302 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.802446 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.802598 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.802759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.802906 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.803059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.803212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.803366 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.803511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.803707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.803864 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.804011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.804183 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.804861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.805010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.805165 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.805327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.805482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.805627 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.805779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.805932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.806104 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.806250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.806403 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.806556 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.806702 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.806856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.807011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.807158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.807310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.807481 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.807696 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.807870 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.808203 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.808365 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.808511 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.808663 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.808816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.808970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.809134 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.809375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.809528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.809681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.809828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.809982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.810135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.810282 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.810438 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.810594 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.810750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.810903 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.811057 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.811214 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.811370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.811515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.811697 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.811845 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.811999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.812144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.812297 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.812480 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.812638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.812784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.812945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.813099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.813245 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.813390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.813569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.813717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.813870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.814023 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.814169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.814338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.814486 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.814631 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.814783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.814929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.815074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.815232 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.816021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.816173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.816331 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.816477 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.816634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.816792 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.816945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.817091 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.817235 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.817388 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.817544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.817691 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.817836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.818005 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.818240 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.818420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.818670 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.818829 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.819000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.819152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.819304 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.819470 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.819647 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.819804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.820572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.820572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.820878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.821041 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.821194 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.821345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.821495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.821671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.821833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.821995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.822148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.822300 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.822478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.822644 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.822812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.822974 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.823135 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.823288 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.823451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.823645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.823825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.823987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.824155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.824333 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.824488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.824639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.824803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.824967 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.825121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.825279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.825442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.825596 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.825768 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.825920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.826090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.826242 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.826395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.826555 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.826708 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.826867 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.827021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.827257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.827415 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.827595 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.827756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.827930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.828093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.828264 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.828491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.828683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.828683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.828683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.828683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.829372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.829525 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.829690 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.829843 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.830018 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.830188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.830341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.830501 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.830667 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.830820 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.830980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.831141 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.831295 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.831460 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.831460 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.831821 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.831976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.832136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.832300 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.832462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.832615 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.832785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.832946 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.833116 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.833277 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.833511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.833672 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.833835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.833987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.834137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.834311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.834465 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.834625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.834784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.834962 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.835131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.835293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.835457 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.835668 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.835824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.835995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.836157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.836331 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.836505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.836658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.836809 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.836959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.837125 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.837288 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.837447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.837600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.837770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.837924 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.838083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.838234 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.838395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.838395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.838807 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.839000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.839246 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.839406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.839626 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.839789 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.839960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.840114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.840265 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.840416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.840575 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.840729 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.840905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.841058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.841058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.841353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.841505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.841691 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.841858 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.842011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.842162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.842313 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.842464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.842630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.842630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.842939 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.843091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.843242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.843400 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.843583 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.843744 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.843897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.844059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.844219 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.844372 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.844608 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.844761 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.844925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.845078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.845229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.845404 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.845558 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.845710 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.845861 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.846021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.846173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.846334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.846487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.846645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.846805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.846969 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.847133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.847313 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.847480 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.847707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.847863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.848015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.848175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.848341 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.848493 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.848664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.848888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.849055 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.849254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.849494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.849662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.849815 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.849965 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.850193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.850361 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.850513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.850665 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.850816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.850967 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.851656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.851845 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.852025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.852179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.852342 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.852496 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.852657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.852818 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.852971 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.853131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.853303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.853455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.853621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.853773 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.853943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.854096 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.854247 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.854407 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.854569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.854741 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.854920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.855081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.855243 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.855414 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.855603 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.855774 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.855937 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.856185 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.856349 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.856521 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.856680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.856842 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.856994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.857158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.857311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.857464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.857622 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.857775 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.857934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.858097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.858261 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.858420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.858573 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.858735 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.858907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.859162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.859328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.859509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.859775 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.859947 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.860117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.860300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.860459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.860647 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.860801 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.860962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.861130 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.861283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.861442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.861604 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.861836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.861998 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.862237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.862645 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.862799 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.862963 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.863115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.863298 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.863465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.863665 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.863834 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.863988 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.864140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.864140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.864449 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.864609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.864769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.864931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.865102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.865271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.865442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.865597 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.865756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.865909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.866070 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.866236 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.866388 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.866539 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.866690 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.867402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.867602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.867792 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.867950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.868184 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.868346 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.868508 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.868670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.868831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.868984 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.869161 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.869408 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.869566 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.869727 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.869997 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.870177 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.870332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.870491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.870651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.870819 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.870972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.871124 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.871124 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.871421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.871421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.871797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.871797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.872100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.872100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.872414 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.872575 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.872737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.872898 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.873075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.873231 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.873390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.873552 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.873786 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.873954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.874114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.874280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.874431 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.874590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.874742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.874894 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.875043 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.875193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.875359 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.875526 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.875701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.875853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.876005 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.876156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.876319 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.876483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.876643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.876795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.876795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.877083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.877248 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.877401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.877568 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.877722 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.877890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.878041 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.878202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.878374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.878537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.878689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.878849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.879077 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.879240 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.879411 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.879668 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.879836 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.880016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.880272 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.880440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.880604 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.880756 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.880908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.881066 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.881228 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.881389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.881540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.881692 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.881843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.881995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.882160 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.882320 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.882502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.882675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.882828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.882987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.883153 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.883325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.883477 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.883695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.883858 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.884020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.884180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.884340 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.884500 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.884651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.884813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.884974 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.885127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.885278 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.885438 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.885599 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.885761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.885922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.886081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.886234 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.886384 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.886537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.886695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.886872 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.887025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.887187 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.887338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.887488 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.887663 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.887834 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.887995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.888153 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.888305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.888456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.888616 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.888778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.888937 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.889089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.889250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.889411 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.889589 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.889845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.890015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.890176 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.890442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.890442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.890750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.890903 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.891066 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.891217 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.891368 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.891528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.891715 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.891870 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.892021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.892172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.892323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.892323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.892629 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.892803 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.892961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.893141 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.893314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.893314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.893721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.893874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.894033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.894194 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.894355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.894517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.894676 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.894846 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.894998 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.895161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.895329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.895487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.895664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.895818 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.895980 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.896138 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.896312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.896464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.896614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.896765 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.896916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.897075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.897254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.897417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.897569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.897719 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.897878 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.898052 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.898223 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.898386 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.898547 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.898706 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.898858 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.899023 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.899182 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.899346 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.899505 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.899731 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.899985 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.900160 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.900321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.900593 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.900764 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.900926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.901094 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.901267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.901443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.901619 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.901787 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.901950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.902103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.902254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.902413 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.902567 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.902726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.902887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.903041 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.903201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.903354 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.903505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.903691 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.903857 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.904010 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.904161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.904312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.904469 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.904634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.904634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.904932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.905085 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.905238 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.905399 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.905561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.905738 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.905900 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.906061 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.906213 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.906365 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.906530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.906683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.906834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.906985 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.907158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.907322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.907488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.907680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.907847 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.907999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.908150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.908316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.908476 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.908628 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.908787 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.908941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.909100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.909261 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.909414 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.909584 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.909843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.910093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.910260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.910425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.910578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.910737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.910991 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.911164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.911343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.911513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.911740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.911916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.912086 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.912254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.912254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.912557 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.912709 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.912867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.913020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.913194 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.913379 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.913561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.914250 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.914412 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.914564 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.914740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.914917 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.915093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.915259 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.915441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.915626 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.915801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.915962 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.916115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.916267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.916457 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.916652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.916913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.917077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.917231 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.917390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.917558 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.917714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.917875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.918027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.918178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.918330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.918489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.918658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.918658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.918966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.919127 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.919287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.919287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.919647 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.919814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.919991 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.920234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.920393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.920393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.920692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.920845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.921026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.921276 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.921445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.921598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.921764 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.921764 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.922061 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.922212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.922363 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.922533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.922686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.922837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.922987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.923157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.923317 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.923478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.923656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.923810 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.923960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.924110 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.924272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.924434 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.924613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.924769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.924920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.924920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.925286 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.925457 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.925637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.925800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.925966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.926134 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.926301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.926462 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.926614 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.926614 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.926910 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.927076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.927254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.927408 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.927627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.927801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.927969 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.928138 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.928291 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.928450 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.928603 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.928766 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.928928 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.929095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.929283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.929977 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.930147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.930391 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.930550 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.930716 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.930871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.931030 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.931182 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.931446 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.931636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.931804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.931958 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.932144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.932300 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.932451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.932617 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.932778 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.932939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.933101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.933270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.933422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.933588 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.933748 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.933901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.934090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.934243 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.934395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.934561 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.934713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.934871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.935033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.935211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.935382 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.935382 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.935729 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.935891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.935891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.936223 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.936388 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.936541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.936693 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.936882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.937040 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.937192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.937366 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.937536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.937701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.937853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.938038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.938209 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.938385 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.938543 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.938695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.938869 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.939046 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.939210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.939369 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.939532 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.939532 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.939868 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.940022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.940189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.940370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.940370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.940737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.940890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.941049 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.941212 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.941373 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.941656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.941816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.941976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.942139 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.942292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.942445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.942607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.942767 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.942927 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.943089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.943250 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.943403 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.943622 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.943797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.943977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.944145 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.944299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.944472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.944650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.944815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.945297 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.945471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.945633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.945820 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.945977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.946128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.946289 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.946442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.946594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.946760 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.946931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.947121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.947294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.947474 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.947664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.947832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.947984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.948144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.948396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.948555 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.948716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.948868 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.949019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.949268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.949480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.949695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.949870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.950033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.950193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.950360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.950522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.950780 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.950938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.951100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.951256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.951256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.951643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.951905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.952090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.952254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.952416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.952584 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.952738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.952891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.953056 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.953212 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.953379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.953541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.953720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.953920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.953920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.954348 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.954512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.954673 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.954828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.954981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.955133 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.955286 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.955453 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.955645 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.955814 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.955969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.956142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.956305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.956482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.956637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.956800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.956961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.957115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.957276 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.957428 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.957582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.957582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.957582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.958026 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.958195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.958354 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.958515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.958675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.958828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.958980 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.959160 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.959315 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.959475 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.959673 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.959828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.959980 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.960155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.960310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.960494 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.960666 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.960928 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.961099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.961256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.961417 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.961571 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.961732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.961904 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.962184 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.962347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.962513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.962665 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.962825 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.962988 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.963155 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.963311 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.963472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.963661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.963818 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.963981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.964143 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.964296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.964485 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.964641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.964816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.964985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.965147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.965300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.965461 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.965629 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.965794 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.965966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.966126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.966126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.966437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.966437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.966738 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.966738 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.967054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.967221 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.967390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.967390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.967735 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.967893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.968052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.968205 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.968365 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.968519 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.968694 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.968848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.969000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.969152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.969303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.969455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.969620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.969776 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.969929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.970081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.970244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.970409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.970572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.970734 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.970906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.971142 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.971301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.971468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.971668 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.971833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.971986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.972181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.972425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.972594 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.972764 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.972941 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.973109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.973267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.973429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.973582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.973741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.973896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.974053 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.974206 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.974405 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.974580 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.974742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.974920 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.975109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.975267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.975434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.975621 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.975794 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.975975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.976653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.976876 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977206 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 14:20:28.977703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.977703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.978887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.978887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.978887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.978887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.978887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.978887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.978887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.978887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.980078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.980078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.980078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.980078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.980078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.980078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.980078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.980078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.981490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.981490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.981490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.981490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.981490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.981490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.981490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.981490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.982871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.982871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.982871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.982871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.982871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.982871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.982871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.984001 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.984001 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.984001 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.984001 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.984587 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.984738 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.984988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.985310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.985669 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.986008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 14:20:28.986263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 14:20:29.007133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_db.sqlalchemy.engines [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:20:29.025459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_db.sqlalchemy.engines [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:20:29.351835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.context [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af7bb5ca-612d-46a1-a71f-5077f87c311e(cell1) {{(pid=106811) load_cells /opt/stack/nova/nova/context.py:464}} May 28 14:20:29.356152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:29.357821 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:29.358661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:29.360687 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:29.364730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.context [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af7bb5ca-612d-46a1-a71f-5077f87c311e(cell1) {{(pid=106812) load_cells /opt/stack/nova/nova/context.py:464}} May 28 14:20:29.369126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:29.370813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:29.371681 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:29.373758 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:29.389827 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_db.sqlalchemy.engines [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:20:29.390665 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_db.sqlalchemy.engines [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:20:29.399184 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_db.sqlalchemy.engines [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:20:29.400056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_db.sqlalchemy.engines [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:20:29.421864 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_db.sqlalchemy.engines [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:20:29.430176 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_db.sqlalchemy.engines [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 14:20:29.748165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: WARNING keystonemiddleware.auth_token [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 14:20:29.755785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: WARNING keystonemiddleware.auth_token [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 14:20:29.760103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: WARNING keystonemiddleware.auth_token [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 14:20:29.767742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: WARNING keystonemiddleware.auth_token [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 14:20:29.997141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: WARNING keystonemiddleware.auth_token [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 14:20:30.002679 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: WARNING keystonemiddleware.auth_token [None req-044dd101-fb50-47f2-a1a2-258d46dbd523 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 14:20:30.005388 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: WARNING keystonemiddleware.auth_token [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 14:20:30.008379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2b5fb89c0 pid: 106811 (default app) May 28 14:20:30.011349 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: WARNING keystonemiddleware.auth_token [None req-244e5aa8-b699-45ed-bf23-121a98053a57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 14:20:30.016639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2b5fb89c0 pid: 106812 (default app) May 28 14:21:05.495779 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-21daede3-6619-4181-8942-0cc826d3c466 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Action: 'create', calling method: .version_select at 0x7f2aaf9708b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2045099447"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:08.627247 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-21daede3-6619-4181-8942-0cc826d3c466 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.571945 May 28 14:21:08.628813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Fri May 28 14:21:04 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 4576 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 28 14:21:08.642398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-37ad137c-4957-46a5-ab46-8a254aa5c19a tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaef543a0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:08.993889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-37ad137c-4957-46a5-ab46-8a254aa5c19a tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 200 len: 345 microversion: 2.1 time: 0.356253 May 28 14:21:08.995782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 2/2] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:21:08 2021] GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 345 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:21:09.605221 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-713421567", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "91ebc16a-e9fa-40de-8d8f-6fe4965dc314"}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:10.009863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-197ab1d3-e803-4804-b4f7-91c223fa7b3b tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaef54c10>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:10.103378 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] validate_networks() for [('91ebc16a-e9fa-40de-8d8f-6fe4965dc314', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:21:10.179282 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-197ab1d3-e803-4804-b4f7-91c223fa7b3b tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 200 len: 346 microversion: 2.1 time: 0.175264 May 28 14:21:10.180151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 3/3] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:21:10 2021] GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:10.196606 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7c71ee25-2b92-4ab2-8b88-fb2ee2826777 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Action: 'create', calling method: .version_select at 0x7f2aaef54f70>, body: {"snapshot": {"volume_id": "71c4ee76-5886-499f-bdcc-93faafd0c83a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1538646552"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:11.126731 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7c71ee25-2b92-4ab2-8b88-fb2ee2826777 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.935266 May 28 14:21:11.128455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 4/4] 10.222.0.59 () {60 vars in 1162 bytes} [Fri May 28 14:21:10 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:21:11.142038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5d130de1-ff0d-45c3-92ed-3b7294ca3508 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaeeef040>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:11.203876 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5d130de1-ff0d-45c3-92ed-3b7294ca3508 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 200 len: 287 microversion: 2.1 time: 0.068904 May 28 14:21:11.204798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 5/5] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:11 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:11.221626 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-010059d7-d59a-4b04-81e6-9f02e97654da tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaeeef9d0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:11.332356 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-010059d7-d59a-4b04-81e6-9f02e97654da tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.118082 May 28 14:21:11.332913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 6/6] 10.222.0.59 () {58 vars in 1140 bytes} [Fri May 28 14:21:11 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:11.344163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8219b683-311a-4649-a1e4-2996b5916011 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaeeefa60>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:11.529322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8219b683-311a-4649-a1e4-2996b5916011 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 200 len: 287 microversion: 2.1 time: 0.189209 May 28 14:21:11.529898 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 7/7] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:11 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 287 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:21:12.480297 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:21:12.480811 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:21:12.481278 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:21:12.481699 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:21:12.482177 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:21:12.502987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:12.505911 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:12.507162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:12.508848 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:12.541158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-455e857e-9e24-49a0-a729-7049c3f04e66 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaeeef430>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:12.550007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Getting quotas for project 99ce685b86cb47abba407b2e49dcf373. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:21:12.559341 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Getting quotas for user 64aeb8c620af4a1398f7505cde5a58f7 and project 99ce685b86cb47abba407b2e49dcf373. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:21:12.601963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:21:12.610789 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:21:12.656319 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-455e857e-9e24-49a0-a729-7049c3f04e66 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 200 len: 287 microversion: 2.1 time: 0.119551 May 28 14:21:12.660732 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 8/8] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:12 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:12.863685 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-98a24f30-a8a2-429d-909a-315071350179 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.302520 May 28 14:21:12.870750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 1/9] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:21:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 4311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:21:12.876242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fae17424-9879-4e60-9430-de15d9f863b5 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:12.877195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fae17424-9879-4e60-9430-de15d9f863b5 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:13.172931 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fae17424-9879-4e60-9430-de15d9f863b5 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:13.191127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fae17424-9879-4e60-9430-de15d9f863b5 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1214 microversion: 2.1 time: 0.316137 May 28 14:21:13.192201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 9/10] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:12 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1214 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:13.673545 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c00617bd-88c0-471a-ad9c-0f82622a1318 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaefa4160>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:13.822836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c00617bd-88c0-471a-ad9c-0f82622a1318 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 200 len: 287 microversion: 2.1 time: 0.157408 May 28 14:21:13.827837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 2/11] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:13 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:14.208505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b8363d25-7698-41ca-b9b8-3da0db2ee289 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:14.210179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b8363d25-7698-41ca-b9b8-3da0db2ee289 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:14.370376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b8363d25-7698-41ca-b9b8-3da0db2ee289 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:14.384119 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b8363d25-7698-41ca-b9b8-3da0db2ee289 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1214 microversion: 2.1 time: 0.178098 May 28 14:21:14.385633 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 10/12] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:14 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:14.838650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bd0a000c-7711-43f3-b0aa-bcd1ad67f639 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaefa4ca0>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:14.933813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bd0a000c-7711-43f3-b0aa-bcd1ad67f639 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 200 len: 287 microversion: 2.1 time: 0.102369 May 28 14:21:14.935071 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 3/13] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:14 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:15.405721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:15.407638 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:15.424982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:15.426422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:15.427246 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:15.427854 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:15.692020 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:15.702702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1218 microversion: 2.1 time: 0.302417 May 28 14:21:15.703349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 11/14] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:15 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1218 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:15.947590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3e0a8abb-6491-4f41-bcc6-9fd1721fa7c3 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aae635a60>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:16.019634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3e0a8abb-6491-4f41-bcc6-9fd1721fa7c3 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 200 len: 287 microversion: 2.1 time: 0.076912 May 28 14:21:16.020566 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 4/15] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:15 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:16.721027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:16.732172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:16.745423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:16.746201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:16.747336 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:16.748095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:16.918021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:16.930347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1210 microversion: 2.1 time: 0.213569 May 28 14:21:16.931717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 12/16] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:16 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1210 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:17.032269 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b49ae741-d59e-4ee3-81f6-63bb5ac01d3e tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aae63e3a0>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:17.129910 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b49ae741-d59e-4ee3-81f6-63bb5ac01d3e tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 200 len: 288 microversion: 2.1 time: 0.102619 May 28 14:21:17.136034 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 5/17] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:17 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:17.143399 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d9942767-68cf-4816-89bc-0210543ae50b tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaeea2820>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:17.501165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d9942767-68cf-4816-89bc-0210543ae50b tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 202 len: 0 microversion: 2.1 time: 0.362496 May 28 14:21:17.505389 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 13/18] 10.222.0.59 () {58 vars in 1254 bytes} [Fri May 28 14:21:17 2021] DELETE /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:21:17.511703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-51a677cd-0cbd-4e0e-b1fa-9e6e23ad7d9c tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aae635ee0>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:17.672702 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-51a677cd-0cbd-4e0e-b1fa-9e6e23ad7d9c tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 200 len: 287 microversion: 2.1 time: 0.165245 May 28 14:21:17.676938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 6/19] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:17 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:17.949642 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8b82c029-9775-4324-a2d9-f6a42953ba48 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:17.950979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8b82c029-9775-4324-a2d9-f6a42953ba48 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:17.964084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b82c029-9775-4324-a2d9-f6a42953ba48 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:17.964859 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b82c029-9775-4324-a2d9-f6a42953ba48 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:17.970881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b82c029-9775-4324-a2d9-f6a42953ba48 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:17.971531 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b82c029-9775-4324-a2d9-f6a42953ba48 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:18.358960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8b82c029-9775-4324-a2d9-f6a42953ba48 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:18.385444 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8b82c029-9775-4324-a2d9-f6a42953ba48 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1266 microversion: 2.1 time: 0.431109 May 28 14:21:18.385444 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 14/20] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:17 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1266 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:18.743880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-364d088a-1017-4b80-96fc-07e4829b56d6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaeea2a60>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:18.785516 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-09f69f91-fdbb-4f42-b552-88282cceee66 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'create', calling method: .version_select at 0x7f2aae635550>, body: {"keypair": {"name": "tempest-keypair-1239197473"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:18.826768 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-09f69f91-fdbb-4f42-b552-88282cceee66 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:21:18.831210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-09f69f91-fdbb-4f42-b552-88282cceee66 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for user 3c5d9664f5ec42ce8aa849388e53c404 and project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:21:18.873268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-364d088a-1017-4b80-96fc-07e4829b56d6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] HTTP exception thrown: Snapshot 72e85000-5c0e-4a82-8757-8f2259e44509 could not be found. May 28 14:21:18.874150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-364d088a-1017-4b80-96fc-07e4829b56d6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Returning 404 to user: Snapshot 72e85000-5c0e-4a82-8757-8f2259e44509 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:21:18.875182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-364d088a-1017-4b80-96fc-07e4829b56d6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509" status: 404 len: 111 microversion: 2.1 time: 0.191713 May 28 14:21:18.879971 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 15/21] 10.222.0.59 () {58 vars in 1251 bytes} [Fri May 28 14:21:18 2021] GET /compute/v2.1/os-snapshots/72e85000-5c0e-4a82-8757-8f2259e44509 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:21:18.888820 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-71d6b8c2-7d5b-4c01-9905-49c0b33f2b96 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaf930dc0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:19.293635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-71d6b8c2-7d5b-4c01-9905-49c0b33f2b96 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 202 len: 0 microversion: 2.1 time: 0.410460 May 28 14:21:19.294583 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 16/22] 10.222.0.59 () {58 vars in 1248 bytes} [Fri May 28 14:21:18 2021] DELETE /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:21:19.302883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e724f545-b7e9-454f-b6fa-7f73eb8a8801 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaee3a700>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:19.566923 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e724f545-b7e9-454f-b6fa-7f73eb8a8801 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 200 len: 345 microversion: 2.1 time: 0.268137 May 28 14:21:19.568026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 17/23] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:21:19 2021] GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 345 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:21:19.574013 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:19.576180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:19.593687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-09f69f91-fdbb-4f42-b552-88282cceee66 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:21:19.606754 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-09f69f91-fdbb-4f42-b552-88282cceee66 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for user 3c5d9664f5ec42ce8aa849388e53c404 and project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:21:19.610113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:19.617124 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:19.618156 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:19.619666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:19.658972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-09f69f91-fdbb-4f42-b552-88282cceee66 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.508101 May 28 14:21:19.663639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 7/24] 10.222.0.59 () {62 vars in 1199 bytes} [Fri May 28 14:21:18 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1513 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 28 14:21:20.066600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:20.082316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1272 microversion: 2.1 time: 0.513037 May 28 14:21:20.082916 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 18/25] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:19 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:20.581810 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f4808135-eaa5-43f5-b61b-81f3493334d6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aae63e700>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:20.801877 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f4808135-eaa5-43f5-b61b-81f3493334d6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 200 len: 345 microversion: 2.1 time: 0.224372 May 28 14:21:20.807928 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 8/26] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:21:20 2021] GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 345 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:21.100777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-acb22487-7c95-435e-853b-a13905cb023a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:21.101373 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-acb22487-7c95-435e-853b-a13905cb023a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:21.119380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acb22487-7c95-435e-853b-a13905cb023a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:21.119972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acb22487-7c95-435e-853b-a13905cb023a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:21.120680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acb22487-7c95-435e-853b-a13905cb023a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:21.121120 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acb22487-7c95-435e-853b-a13905cb023a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:21.637256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-682923959", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1145a91e-035d-40fe-813b-06d960bbe8ad"}]}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:21.887108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] validate_networks() for [('1145a91e-035d-40fe-813b-06d960bbe8ad', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:21:22.134869 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-acb22487-7c95-435e-853b-a13905cb023a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:22.152142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-acb22487-7c95-435e-853b-a13905cb023a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 1.055712 May 28 14:21:22.161617 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 9/27] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:21 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:22.168002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-39be37a9-5893-47aa-8892-e2a44a43ea4d tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaddf2b80>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:22.361919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-39be37a9-5893-47aa-8892-e2a44a43ea4d tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 200 len: 345 microversion: 2.1 time: 0.198276 May 28 14:21:22.363385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 10/28] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:21:22 2021] GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:23.188229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a4df0608-08cd-49a6-9999-66ac3176d169 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:23.190340 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a4df0608-08cd-49a6-9999-66ac3176d169 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:23.204325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a4df0608-08cd-49a6-9999-66ac3176d169 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:23.212399 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a4df0608-08cd-49a6-9999-66ac3176d169 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:23.213522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a4df0608-08cd-49a6-9999-66ac3176d169 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:23.214290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a4df0608-08cd-49a6-9999-66ac3176d169 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:23.503520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:21:23.504715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:21:23.505394 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:21:23.507198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:21:23.507841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:21:23.540529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:23.541738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:23.542806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:23.543834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:23.597570 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Getting quotas for project 71fbb9d6a3b643238579cd1698ca83e1. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:21:23.613074 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Getting quotas for user 4720d0d2604545bfbd08e665b32fb612 and project 71fbb9d6a3b643238579cd1698ca83e1. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:21:23.629693 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:21:23.639131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:21:23.841946 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a4df0608-08cd-49a6-9999-66ac3176d169 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:23.870806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a4df0608-08cd-49a6-9999-66ac3176d169 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.682847 May 28 14:21:23.871701 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 11/29] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:23 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:23.881534 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ed669869-8925-489c-b6b8-67b429c7dd6d tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaddf24c0>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:23.938656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-685200a0-3ae5-4924-95bf-10d987ed135a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.861790 May 28 14:21:23.951804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 19/30] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:21:21 2021] POST /compute/v2.1/servers => generated 383 bytes in 2876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:21:23.964677 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1241a4fc-ce69-4c4d-92ca-296bc2028393 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:23.965322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1241a4fc-ce69-4c4d-92ca-296bc2028393 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:24.112245 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ed669869-8925-489c-b6b8-67b429c7dd6d tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 200 len: 345 microversion: 2.1 time: 0.228181 May 28 14:21:24.112245 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 12/31] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:21:23 2021] GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 345 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:24.260007 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1241a4fc-ce69-4c4d-92ca-296bc2028393 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:24.269562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1241a4fc-ce69-4c4d-92ca-296bc2028393 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1221 microversion: 2.1 time: 0.314301 May 28 14:21:24.270519 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 20/32] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:23 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1221 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:24.488828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-584533212", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1145a91e-035d-40fe-813b-06d960bbe8ad"}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:24.609351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] validate_networks() for [('1145a91e-035d-40fe-813b-06d960bbe8ad', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:21:24.887943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:24.889066 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:24.905057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:24.905691 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:24.908140 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:24.910174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:25.672104 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:25.684094 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.800046 May 28 14:21:25.685189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 21/33] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:24 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:25.691479 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2f739d7c-4c3d-4c46-b6e4-e2d0f37c5ad6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaed89f70>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:25.892028 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-2f739d7c-4c3d-4c46-b6e4-e2d0f37c5ad6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] HTTP exception thrown: Volume 71c4ee76-5886-499f-bdcc-93faafd0c83a could not be found. May 28 14:21:25.892665 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2f739d7c-4c3d-4c46-b6e4-e2d0f37c5ad6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Returning 404 to user: Volume 71c4ee76-5886-499f-bdcc-93faafd0c83a could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:21:25.894142 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2f739d7c-4c3d-4c46-b6e4-e2d0f37c5ad6 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 404 len: 109 microversion: 2.1 time: 0.207740 May 28 14:21:25.894725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 22/34] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:21:25 2021] GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 109 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:21:25.916918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4d4276c8-5b97-467a-bce5-5c9ef0408c0d tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaed804c0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:26.043210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:21:26.043743 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:21:26.044607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:21:26.045201 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:21:26.045774 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:21:26.079639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:26.080530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:26.081495 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:26.082107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:26.087089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-4d4276c8-5b97-467a-bce5-5c9ef0408c0d tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] HTTP exception thrown: Volume 71c4ee76-5886-499f-bdcc-93faafd0c83a could not be found. May 28 14:21:26.088093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4d4276c8-5b97-467a-bce5-5c9ef0408c0d tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Returning 404 to user: Volume 71c4ee76-5886-499f-bdcc-93faafd0c83a could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:21:26.090893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4d4276c8-5b97-467a-bce5-5c9ef0408c0d tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 404 len: 109 microversion: 2.1 time: 0.184419 May 28 14:21:26.091730 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 23/35] 10.222.0.59 () {58 vars in 1248 bytes} [Fri May 28 14:21:25 2021] DELETE /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 109 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:21:26.100433 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4d87cb52-4117-4205-b39a-cd3b933f1d20 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Calling method '.version_select at 0x7f2aaed72dc0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:26.135510 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Getting quotas for project 71fbb9d6a3b643238579cd1698ca83e1. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:21:26.147888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Getting quotas for user 4720d0d2604545bfbd08e665b32fb612 and project 71fbb9d6a3b643238579cd1698ca83e1. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:21:26.171331 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:21:26.173662 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:21:26.432963 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-4d87cb52-4117-4205-b39a-cd3b933f1d20 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] HTTP exception thrown: Volume 71c4ee76-5886-499f-bdcc-93faafd0c83a could not be found. May 28 14:21:26.433843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4d87cb52-4117-4205-b39a-cd3b933f1d20 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] Returning 404 to user: Volume 71c4ee76-5886-499f-bdcc-93faafd0c83a could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:21:26.434744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4d87cb52-4117-4205-b39a-cd3b933f1d20 tempest-VolumesSnapshotsTestJSON-204493210 tempest-VolumesSnapshotsTestJSON-204493210-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a" status: 404 len: 109 microversion: 2.1 time: 0.338837 May 28 14:21:26.435443 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 24/36] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:21:26 2021] GET /compute/v2.1/os-volumes/71c4ee76-5886-499f-bdcc-93faafd0c83a => generated 109 bytes in 340 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:21:26.438724 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-73ebe19f-50b6-4778-ac1d-4a5eef093336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.947448 May 28 14:21:26.441244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 13/37] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:21:24 2021] POST /compute/v2.1/servers => generated 383 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:21:26.472982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5deab5af-e0e5-40d2-b6a8-536ac6e51374 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:26.472982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5deab5af-e0e5-40d2-b6a8-536ac6e51374 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:26.642618 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5deab5af-e0e5-40d2-b6a8-536ac6e51374 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:26.660789 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-819978267", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "936c4847-d3d4-4250-b543-dc72dd308858"}], "security_groups": [{"name": "tempest-securitygroup--953632368"}], "key_name": "tempest-keypair-1239197473", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:26.675185 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5deab5af-e0e5-40d2-b6a8-536ac6e51374 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1221 microversion: 2.1 time: 0.220651 May 28 14:21:26.677813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 25/38] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:26 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:26.704175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c921aac6-2102-4a10-b6ff-0ced79ebd31e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:26.704619 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c921aac6-2102-4a10-b6ff-0ced79ebd31e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:26.736506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c921aac6-2102-4a10-b6ff-0ced79ebd31e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:26.740493 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c921aac6-2102-4a10-b6ff-0ced79ebd31e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:26.741993 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c921aac6-2102-4a10-b6ff-0ced79ebd31e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:26.776328 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c921aac6-2102-4a10-b6ff-0ced79ebd31e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:27.142060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] validate_networks() for [('936c4847-d3d4-4250-b543-dc72dd308858', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:21:27.270165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c921aac6-2102-4a10-b6ff-0ced79ebd31e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:27.298602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c921aac6-2102-4a10-b6ff-0ced79ebd31e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.597727 May 28 14:21:27.307658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 26/39] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:26 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:27.693254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2dc45ad1-1346-46e2-a318-907b503f2e5b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:27.693884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2dc45ad1-1346-46e2-a318-907b503f2e5b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:27.892192 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2dc45ad1-1346-46e2-a318-907b503f2e5b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:27.914345 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2dc45ad1-1346-46e2-a318-907b503f2e5b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1221 microversion: 2.1 time: 0.224919 May 28 14:21:27.925689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 27/40] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:27 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1221 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:28.313548 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:28.315201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:28.331600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:28.334395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:28.335349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:28.337530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:28.853804 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:21:28.854305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:21:28.854845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:21:28.855313 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:21:28.855775 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:21:28.867880 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:28.868348 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:28.869825 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:28.870544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:28.903773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:21:28.911262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for user 3c5d9664f5ec42ce8aa849388e53c404 and project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:21:28.936601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:21:28.940430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:21:29.105263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.448924 May 28 14:21:29.107807 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 14/41] 10.222.0.59 () {62 vars in 1188 bytes} [Fri May 28 14:21:26 2021] POST /compute/v2.1/servers => generated 401 bytes in 2452 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 14:21:29.121109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-61c3eda6-ee11-487f-bd85-b8ab03640125 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:29.124039 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-61c3eda6-ee11-487f-bd85-b8ab03640125 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:29.141936 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-61c3eda6-ee11-487f-bd85-b8ab03640125 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:29.144295 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-61c3eda6-ee11-487f-bd85-b8ab03640125 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:29.147160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-61c3eda6-ee11-487f-bd85-b8ab03640125 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:29.149044 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-61c3eda6-ee11-487f-bd85-b8ab03640125 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:29.257677 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:29.298161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.988991 May 28 14:21:29.305053 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 28/42] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:28 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:29.347485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8df1869f-8e32-4c1f-b90b-986853038519 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:29.348095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8df1869f-8e32-4c1f-b90b-986853038519 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:29.592060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-61c3eda6-ee11-487f-bd85-b8ab03640125 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:29.602412 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-61c3eda6-ee11-487f-bd85-b8ab03640125 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.491984 May 28 14:21:29.602412 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 15/43] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:29 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:29.606973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8df1869f-8e32-4c1f-b90b-986853038519 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:29.639929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8df1869f-8e32-4c1f-b90b-986853038519 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:29.641489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8df1869f-8e32-4c1f-b90b-986853038519 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:29.645421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8df1869f-8e32-4c1f-b90b-986853038519 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1281 microversion: 2.20 time: 0.338974 May 28 14:21:29.657911 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 29/44] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:29 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:30.317766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6c953f78-aaf8-4a26-a369-8d561a846393 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:30.318393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6c953f78-aaf8-4a26-a369-8d561a846393 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:30.326337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6c953f78-aaf8-4a26-a369-8d561a846393 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:30.326942 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6c953f78-aaf8-4a26-a369-8d561a846393 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:30.327836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6c953f78-aaf8-4a26-a369-8d561a846393 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:30.328281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6c953f78-aaf8-4a26-a369-8d561a846393 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:30.562144 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6c953f78-aaf8-4a26-a369-8d561a846393 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:30.562144 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6c953f78-aaf8-4a26-a369-8d561a846393 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.235131 May 28 14:21:30.562144 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 16/45] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:30 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:30.619491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8195ee12-f383-4349-92b2-e9a48f9b77f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:30.620174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8195ee12-f383-4349-92b2-e9a48f9b77f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:30.628132 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8195ee12-f383-4349-92b2-e9a48f9b77f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:30.628598 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8195ee12-f383-4349-92b2-e9a48f9b77f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:30.629402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8195ee12-f383-4349-92b2-e9a48f9b77f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:30.629847 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8195ee12-f383-4349-92b2-e9a48f9b77f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:30.666732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d49fdd64-4573-427f-90fa-55d09701299c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:30.667765 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d49fdd64-4573-427f-90fa-55d09701299c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:30.760207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8195ee12-f383-4349-92b2-e9a48f9b77f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:30.768323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d49fdd64-4573-427f-90fa-55d09701299c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:30.769930 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8195ee12-f383-4349-92b2-e9a48f9b77f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.154932 May 28 14:21:30.770520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 30/46] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:30 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:30.781164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d49fdd64-4573-427f-90fa-55d09701299c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:30.782722 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d49fdd64-4573-427f-90fa-55d09701299c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:30.783881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d49fdd64-4573-427f-90fa-55d09701299c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1281 microversion: 2.20 time: 0.122159 May 28 14:21:30.784442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 17/47] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:30 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:31.582770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-34ea5a66-57e2-4454-8267-cd6ba006ed05 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:31.585700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-34ea5a66-57e2-4454-8267-cd6ba006ed05 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:31.606457 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-34ea5a66-57e2-4454-8267-cd6ba006ed05 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:31.615501 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-34ea5a66-57e2-4454-8267-cd6ba006ed05 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:31.615962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-34ea5a66-57e2-4454-8267-cd6ba006ed05 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:31.617031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-34ea5a66-57e2-4454-8267-cd6ba006ed05 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:31.786537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-519ddd2d-1aee-44ef-a01f-4074c7e0611a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:31.787287 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-519ddd2d-1aee-44ef-a01f-4074c7e0611a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:31.805212 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-519ddd2d-1aee-44ef-a01f-4074c7e0611a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:31.805976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-519ddd2d-1aee-44ef-a01f-4074c7e0611a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:31.816934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-519ddd2d-1aee-44ef-a01f-4074c7e0611a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:31.817389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-519ddd2d-1aee-44ef-a01f-4074c7e0611a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:31.989515 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-519ddd2d-1aee-44ef-a01f-4074c7e0611a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:32.000328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-519ddd2d-1aee-44ef-a01f-4074c7e0611a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.217299 May 28 14:21:32.003053 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 18/48] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:31 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:32.008151 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:32.008988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:32.019455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:32.019455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:32.019455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:32.019455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:32.167212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-34ea5a66-57e2-4454-8267-cd6ba006ed05 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:32.168322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:32.179019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:32.182020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:32.192805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1285 microversion: 2.20 time: 0.185068 May 28 14:21:32.193540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-34ea5a66-57e2-4454-8267-cd6ba006ed05 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.619928 May 28 14:21:32.193540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 31/49] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:31 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:32.194317 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 19/50] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:32 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:32.303856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-ceea52e2-6344-4ebb-9f20-786d4b9cc734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da8b01f-1c47-4118-bc09-bffde9f331b7", "tag": "6bfc4f29-c29d-4098-8314-02d1e6aa02a9"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:32.307106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:21:32.307106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:21:32.320483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-ceea52e2-6344-4ebb-9f20-786d4b9cc734 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:32.321175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-ceea52e2-6344-4ebb-9f20-786d4b9cc734 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:32.350869 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-ceea52e2-6344-4ebb-9f20-786d4b9cc734 service nova] Creating event network-changed:6bfc4f29-c29d-4098-8314-02d1e6aa02a9 for instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 on hv-cinder-79128 May 28 14:21:32.351889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-ceea52e2-6344-4ebb-9f20-786d4b9cc734 service nova] Acquired lock "compute-rpcapi-router" {{(pid=106811) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 28 14:21:32.353289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac9933fa-e7bf-4872-8feb-99d426ff1086 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:32.353951 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac9933fa-e7bf-4872-8feb-99d426ff1086 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:32.354967 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac9933fa-e7bf-4872-8feb-99d426ff1086 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:32.355529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac9933fa-e7bf-4872-8feb-99d426ff1086 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:32.367435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.compute.rpcapi [None req-ac9933fa-e7bf-4872-8feb-99d426ff1086 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 28 14:21:32.368385 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ac9933fa-e7bf-4872-8feb-99d426ff1086 None None] Releasing lock "compute-rpcapi-router" {{(pid=106811) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 28 14:21:32.409850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ac9933fa-e7bf-4872-8feb-99d426ff1086 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204751 May 28 14:21:32.410721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 32/51] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:21:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:33.020447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-be58be62-55d5-4250-9b83-8577483a84fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:33.023311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-be58be62-55d5-4250-9b83-8577483a84fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:33.037831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-be58be62-55d5-4250-9b83-8577483a84fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.039480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-be58be62-55d5-4250-9b83-8577483a84fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.040737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-be58be62-55d5-4250-9b83-8577483a84fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.042223 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-be58be62-55d5-4250-9b83-8577483a84fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.167618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-be58be62-55d5-4250-9b83-8577483a84fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:33.176111 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-be58be62-55d5-4250-9b83-8577483a84fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.161423 May 28 14:21:33.176695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 20/52] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:33 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:33.220477 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d457b304-00f8-42cc-8cfd-63d6dff1b656 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:33.221245 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d457b304-00f8-42cc-8cfd-63d6dff1b656 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:33.224584 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:33.225294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:33.235206 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.235344 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d457b304-00f8-42cc-8cfd-63d6dff1b656 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.235692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d457b304-00f8-42cc-8cfd-63d6dff1b656 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.235813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.236490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d457b304-00f8-42cc-8cfd-63d6dff1b656 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.236678 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.237077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.244715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d457b304-00f8-42cc-8cfd-63d6dff1b656 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.420436 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:33.430504 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:33.436791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:33.438533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a34669d5-8341-4831-835b-6017a978fc94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1285 microversion: 2.20 time: 0.219158 May 28 14:21:33.439345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 21/53] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:33 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:33.500329 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d457b304-00f8-42cc-8cfd-63d6dff1b656 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:33.510333 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d457b304-00f8-42cc-8cfd-63d6dff1b656 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.295289 May 28 14:21:33.511377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 33/54] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:33 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:34.194676 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:34.198309 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:34.206092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:34.209842 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:34.210680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:34.211136 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:34.377362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:34.395760 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.205257 May 28 14:21:34.396704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 22/55] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:34 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:34.457817 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:34.458791 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:34.480552 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:34.481012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:34.481823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:34.482261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:34.535473 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-715e928b-f243-4ab6-8b02-2388eb4b6979 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:34.536621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-715e928b-f243-4ab6-8b02-2388eb4b6979 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:34.557581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-715e928b-f243-4ab6-8b02-2388eb4b6979 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:34.563016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-715e928b-f243-4ab6-8b02-2388eb4b6979 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:34.567323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-715e928b-f243-4ab6-8b02-2388eb4b6979 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:34.567866 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-715e928b-f243-4ab6-8b02-2388eb4b6979 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:34.718817 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:34.739741 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:34.742862 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:34.745846 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e76818be-73e0-4e42-bc08-06e46297095f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1285 microversion: 2.20 time: 0.291919 May 28 14:21:34.762089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 34/56] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:34 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:21:34.921078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-715e928b-f243-4ab6-8b02-2388eb4b6979 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:34.932253 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-715e928b-f243-4ab6-8b02-2388eb4b6979 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.407992 May 28 14:21:34.936400 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 23/57] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:34 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:35.414310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fabe538b-c576-4123-8fcc-d8f14a77ac4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:35.414953 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fabe538b-c576-4123-8fcc-d8f14a77ac4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:35.422507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fabe538b-c576-4123-8fcc-d8f14a77ac4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:35.422986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fabe538b-c576-4123-8fcc-d8f14a77ac4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:35.423830 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fabe538b-c576-4123-8fcc-d8f14a77ac4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:35.424310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fabe538b-c576-4123-8fcc-d8f14a77ac4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:35.599772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fabe538b-c576-4123-8fcc-d8f14a77ac4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:35.608706 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fabe538b-c576-4123-8fcc-d8f14a77ac4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.199560 May 28 14:21:35.609289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 35/58] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:35 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:35.769969 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:35.770675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:35.778663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:35.779200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:35.782011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:35.782011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:35.897214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:35.906200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:35.907870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:35.909141 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b5aa975b-fbe3-4539-8eef-186185aa76e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1285 microversion: 2.20 time: 0.143128 May 28 14:21:35.909754 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 24/59] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:35 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:35.949755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c0d2c2ea-3961-480f-85af-9353829628b8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:35.950420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c0d2c2ea-3961-480f-85af-9353829628b8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:35.961125 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0d2c2ea-3961-480f-85af-9353829628b8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:35.961125 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0d2c2ea-3961-480f-85af-9353829628b8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:35.961928 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0d2c2ea-3961-480f-85af-9353829628b8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:35.962505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0d2c2ea-3961-480f-85af-9353829628b8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:36.162313 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c0d2c2ea-3961-480f-85af-9353829628b8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:36.170543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c0d2c2ea-3961-480f-85af-9353829628b8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.224676 May 28 14:21:36.176832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 36/60] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:35 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:36.625884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ba50d85c-3915-41ee-98f3-9230563dfabc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:36.626506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ba50d85c-3915-41ee-98f3-9230563dfabc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:36.634181 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ba50d85c-3915-41ee-98f3-9230563dfabc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:36.640069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ba50d85c-3915-41ee-98f3-9230563dfabc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:36.640069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ba50d85c-3915-41ee-98f3-9230563dfabc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:36.640069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ba50d85c-3915-41ee-98f3-9230563dfabc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:36.745911 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ba50d85c-3915-41ee-98f3-9230563dfabc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:36.754002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ba50d85c-3915-41ee-98f3-9230563dfabc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.131925 May 28 14:21:36.754582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 25/61] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:36 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:36.928661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:36.929330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:36.936757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:36.937222 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:36.938024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:36.938472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:37.054070 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:37.067599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:37.069386 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:37.070571 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2e574500-daeb-4001-9c59-b03b14455fcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1285 microversion: 2.20 time: 0.146204 May 28 14:21:37.071127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 37/62] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:36 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:37.188159 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e2573734-bfe1-498e-ac65-3a2539adc71d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:37.188794 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e2573734-bfe1-498e-ac65-3a2539adc71d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:37.196612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2573734-bfe1-498e-ac65-3a2539adc71d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:37.197070 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2573734-bfe1-498e-ac65-3a2539adc71d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:37.197842 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2573734-bfe1-498e-ac65-3a2539adc71d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:37.198282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2573734-bfe1-498e-ac65-3a2539adc71d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:37.408003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e2573734-bfe1-498e-ac65-3a2539adc71d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:37.416351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e2573734-bfe1-498e-ac65-3a2539adc71d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.231409 May 28 14:21:37.421281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 26/63] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:37 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:37.771628 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:37.772280 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:37.779628 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:37.780095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:37.780873 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:37.781317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:37.905302 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:37.914508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.147158 May 28 14:21:37.915613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 38/64] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:37 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:38.094788 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:38.095742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:38.107232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:38.107806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:38.108931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:38.109608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:38.233308 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:38.242798 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:38.244390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:38.245704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1285 microversion: 2.20 time: 0.155870 May 28 14:21:38.246756 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 27/65] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:38 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:38.434935 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-132d824b-cd9b-4990-8a9f-6f556f365d7c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:38.435778 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-132d824b-cd9b-4990-8a9f-6f556f365d7c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:38.444121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-132d824b-cd9b-4990-8a9f-6f556f365d7c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:38.444854 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-132d824b-cd9b-4990-8a9f-6f556f365d7c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:38.445982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-132d824b-cd9b-4990-8a9f-6f556f365d7c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:38.446757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-132d824b-cd9b-4990-8a9f-6f556f365d7c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:38.645083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-132d824b-cd9b-4990-8a9f-6f556f365d7c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:38.654560 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-132d824b-cd9b-4990-8a9f-6f556f365d7c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.223564 May 28 14:21:38.655379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 39/66] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:38 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:38.933065 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7d64751e-461d-43a4-854b-796f54886d40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:38.933697 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7d64751e-461d-43a4-854b-796f54886d40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:38.941204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7d64751e-461d-43a4-854b-796f54886d40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:38.941664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7d64751e-461d-43a4-854b-796f54886d40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:38.942465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7d64751e-461d-43a4-854b-796f54886d40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:38.942950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7d64751e-461d-43a4-854b-796f54886d40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:39.060938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7d64751e-461d-43a4-854b-796f54886d40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:39.070869 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7d64751e-461d-43a4-854b-796f54886d40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.142058 May 28 14:21:39.071938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 28/67] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:38 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:39.264997 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:39.265741 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:39.273644 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:39.274108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:39.274906 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:39.275509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:39.395304 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:39.404986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:39.406534 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:39.410053 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1285 microversion: 2.20 time: 0.146580 May 28 14:21:39.410053 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 40/68] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:39 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:39.671792 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cbf3e190-8e66-44bc-baea-86ea24294f32 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:39.672466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cbf3e190-8e66-44bc-baea-86ea24294f32 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:39.679750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cbf3e190-8e66-44bc-baea-86ea24294f32 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:39.680218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cbf3e190-8e66-44bc-baea-86ea24294f32 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:39.681013 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cbf3e190-8e66-44bc-baea-86ea24294f32 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:39.681468 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cbf3e190-8e66-44bc-baea-86ea24294f32 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:39.907747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cbf3e190-8e66-44bc-baea-86ea24294f32 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:39.918162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cbf3e190-8e66-44bc-baea-86ea24294f32 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.250096 May 28 14:21:39.919738 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 29/69] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:39 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:40.086997 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f58ae789-3794-4505-bf86-c9bbafc0d434 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:40.087653 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f58ae789-3794-4505-bf86-c9bbafc0d434 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:40.094825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f58ae789-3794-4505-bf86-c9bbafc0d434 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:40.095297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f58ae789-3794-4505-bf86-c9bbafc0d434 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:40.096117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f58ae789-3794-4505-bf86-c9bbafc0d434 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:40.096564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f58ae789-3794-4505-bf86-c9bbafc0d434 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:40.214118 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f58ae789-3794-4505-bf86-c9bbafc0d434 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:40.222769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f58ae789-3794-4505-bf86-c9bbafc0d434 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.139463 May 28 14:21:40.223411 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 41/70] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:40 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:40.427170 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:40.427950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:40.435502 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:40.436035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:40.438293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:40.438293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:40.608903 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:40.618696 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:40.620458 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:40.621654 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-edea750b-96e3-4e7f-a0cb-3be82a52b457 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1285 microversion: 2.20 time: 0.199331 May 28 14:21:40.622224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 30/71] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:40 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:40.935742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-51eaf9e4-3be9-495f-8661-2e78035a5f12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:40.936401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-51eaf9e4-3be9-495f-8661-2e78035a5f12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:40.943797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51eaf9e4-3be9-495f-8661-2e78035a5f12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:40.944268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51eaf9e4-3be9-495f-8661-2e78035a5f12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:40.945057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51eaf9e4-3be9-495f-8661-2e78035a5f12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:40.945512 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51eaf9e4-3be9-495f-8661-2e78035a5f12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:41.139466 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-51eaf9e4-3be9-495f-8661-2e78035a5f12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:41.147803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-51eaf9e4-3be9-495f-8661-2e78035a5f12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.215761 May 28 14:21:41.148375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 42/72] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:40 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:41.241539 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-50632f37-d865-49ec-825b-bd729cde10f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:41.242210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-50632f37-d865-49ec-825b-bd729cde10f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:41.249845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50632f37-d865-49ec-825b-bd729cde10f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:41.250506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50632f37-d865-49ec-825b-bd729cde10f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:41.251362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50632f37-d865-49ec-825b-bd729cde10f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:41.251842 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50632f37-d865-49ec-825b-bd729cde10f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:41.367336 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-50632f37-d865-49ec-825b-bd729cde10f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:41.376064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-50632f37-d865-49ec-825b-bd729cde10f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1217 microversion: 2.1 time: 0.138964 May 28 14:21:41.376637 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 31/73] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:41 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:41.640568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:41.641339 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:41.650543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:41.659375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:41.659375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:41.659375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:41.847089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:41.856568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:41.858111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:41.859202 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-be0c8a5c-ee07-49ec-811f-8bde48f1674c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1277 microversion: 2.20 time: 0.222694 May 28 14:21:41.860137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 43/74] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:41 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:42.168195 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-95255ba4-8319-43f7-9496-17dba17e8903 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:42.168901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-95255ba4-8319-43f7-9496-17dba17e8903 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:42.177900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-95255ba4-8319-43f7-9496-17dba17e8903 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:42.185063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-95255ba4-8319-43f7-9496-17dba17e8903 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:42.185063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-95255ba4-8319-43f7-9496-17dba17e8903 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:42.185063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-95255ba4-8319-43f7-9496-17dba17e8903 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:42.394205 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:42.395522 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:42.405381 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:42.405886 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:42.406666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:42.407172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:42.407371 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-95255ba4-8319-43f7-9496-17dba17e8903 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:42.416245 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-95255ba4-8319-43f7-9496-17dba17e8903 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.252347 May 28 14:21:42.426459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 32/75] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:42 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:42.558756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:42.568043 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1273 microversion: 2.1 time: 0.178193 May 28 14:21:42.568859 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 44/76] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:42 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:42.878931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:42.881062 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:42.889112 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:42.889820 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:42.890894 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:42.891604 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:43.012976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:43.023199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:43.024809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:43.033666 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e25993fd-6413-4ce7-b606-0655618ef3bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1277 microversion: 2.20 time: 0.150839 May 28 14:21:43.033666 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 33/77] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:42 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:43.434885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:43.434885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:43.444410 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:43.444950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:43.446019 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:43.446641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:43.585324 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:43.585859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:43.593226 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:43.593977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:43.595020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:43.595727 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:43.748594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:43.757895 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1279 microversion: 2.1 time: 0.176944 May 28 14:21:43.758483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 34/78] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:43 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:44.043467 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:44.046772 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:44.047831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:44.053640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.624034 May 28 14:21:44.054230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 45/79] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:43 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:44.061891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:44.062458 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:44.063337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:44.064271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:44.232770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:44.246612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:44.249048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:44.250280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-16ad087b-2c66-442a-9ada-76f85d6a086f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1333 microversion: 2.20 time: 0.209675 May 28 14:21:44.260584 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 35/80] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:44 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1333 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:44.780646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-598dd367-f87d-47f1-b8d1-686e251b2b3e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:44.781268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-598dd367-f87d-47f1-b8d1-686e251b2b3e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:44.815906 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-598dd367-f87d-47f1-b8d1-686e251b2b3e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:44.816370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-598dd367-f87d-47f1-b8d1-686e251b2b3e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:44.817186 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-598dd367-f87d-47f1-b8d1-686e251b2b3e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:44.818148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-598dd367-f87d-47f1-b8d1-686e251b2b3e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:45.075865 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-209c2ca4-d0b8-449e-9144-83289364218d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:45.075865 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-209c2ca4-d0b8-449e-9144-83289364218d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:45.085675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-209c2ca4-d0b8-449e-9144-83289364218d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:45.086533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-209c2ca4-d0b8-449e-9144-83289364218d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:45.088064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-209c2ca4-d0b8-449e-9144-83289364218d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:45.088670 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-209c2ca4-d0b8-449e-9144-83289364218d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:45.205529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-598dd367-f87d-47f1-b8d1-686e251b2b3e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:45.227414 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-598dd367-f87d-47f1-b8d1-686e251b2b3e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1279 microversion: 2.1 time: 0.455806 May 28 14:21:45.228802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 46/81] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:44 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1279 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:45.271071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:45.272208 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:45.282873 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:45.283740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:45.284774 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:45.285402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:45.469994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-209c2ca4-d0b8-449e-9144-83289364218d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:45.480114 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-209c2ca4-d0b8-449e-9144-83289364218d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.408957 May 28 14:21:45.480830 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 36/82] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:45 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:45.538160 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:45.549239 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:45.551036 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:45.552772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1339 microversion: 2.20 time: 0.287103 May 28 14:21:45.553785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 47/83] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:45 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:46.245318 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:46.245846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:46.260626 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:46.260626 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:46.264477 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:46.265109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:46.498036 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:46.499339 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:46.519913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:46.520924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:46.525096 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:46.527600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:47.017884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:47.021602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.527638 May 28 14:21:47.023792 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 48/84] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:46 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:47.035894 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:47.040693 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:47.050621 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:47.051072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:47.052114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:47.060077 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:47.115106 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:47.127100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.884253 May 28 14:21:47.128006 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 37/85] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:46 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:47.138014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-17b5e8cf-8d3d-47b7-bdbf-dc70a4a379a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c17d712-c03d-44ac-bd8d-5f9b99160b0f", "tag": "a600bf0f-8706-4c30-ae48-005a0b8b9b84"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:47.141192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:21:47.141192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:21:47.155890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-17b5e8cf-8d3d-47b7-bdbf-dc70a4a379a0 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:47.156734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-17b5e8cf-8d3d-47b7-bdbf-dc70a4a379a0 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:47.177217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-17b5e8cf-8d3d-47b7-bdbf-dc70a4a379a0 service nova] Creating event network-changed:a600bf0f-8706-4c30-ae48-005a0b8b9b84 for instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f on hv-cinder-79128 May 28 14:21:47.179496 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-17b5e8cf-8d3d-47b7-bdbf-dc70a4a379a0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=106812) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 28 14:21:47.180898 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3bf0263-d838-4bf1-ba4e-312b969f57d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:47.181556 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3bf0263-d838-4bf1-ba4e-312b969f57d5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:47.182542 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3bf0263-d838-4bf1-ba4e-312b969f57d5 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:47.183247 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3bf0263-d838-4bf1-ba4e-312b969f57d5 None None] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:47.193297 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.compute.rpcapi [None req-e3bf0263-d838-4bf1-ba4e-312b969f57d5 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 28 14:21:47.194450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3bf0263-d838-4bf1-ba4e-312b969f57d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=106812) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 28 14:21:47.222435 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e3bf0263-d838-4bf1-ba4e-312b969f57d5 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091087 May 28 14:21:47.223325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 38/86] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:21:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:47.703962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:47.713782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:47.715313 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:47.719943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-207a7bd0-522b-4d82-b833-d297c04cf307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.691395 May 28 14:21:47.725655 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 49/87] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:47 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:48.040852 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:48.041763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:48.060700 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:48.061942 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:48.071475 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:48.072305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:48.145900 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bf69107c-080e-4223-a8b2-8d118653e453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:48.146523 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bf69107c-080e-4223-a8b2-8d118653e453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:48.165634 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bf69107c-080e-4223-a8b2-8d118653e453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:48.166090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bf69107c-080e-4223-a8b2-8d118653e453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:48.173900 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bf69107c-080e-4223-a8b2-8d118653e453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:48.176310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bf69107c-080e-4223-a8b2-8d118653e453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:48.506579 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:48.515601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.479708 May 28 14:21:48.516424 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 39/88] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:48 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:48.586199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-9f58f25b-4618-4241-ba75-13e161051784 req-4467d617-adc7-4e0d-9a68-e44326ec88f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c36e73b-e6ab-4203-ada8-e971693460e2", "tag": "c2872b93-4077-4bc0-8619-140f73de2a3a"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:48.588095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:21:48.588095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:21:48.597983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-9f58f25b-4618-4241-ba75-13e161051784 req-4467d617-adc7-4e0d-9a68-e44326ec88f4 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:48.598518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-9f58f25b-4618-4241-ba75-13e161051784 req-4467d617-adc7-4e0d-9a68-e44326ec88f4 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:48.618707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-9f58f25b-4618-4241-ba75-13e161051784 req-4467d617-adc7-4e0d-9a68-e44326ec88f4 service nova] Creating event network-changed:c2872b93-4077-4bc0-8619-140f73de2a3a for instance 2c36e73b-e6ab-4203-ada8-e971693460e2 on hv-cinder-79128 May 28 14:21:48.624560 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-9f58f25b-4618-4241-ba75-13e161051784 req-4467d617-adc7-4e0d-9a68-e44326ec88f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106827 May 28 14:21:48.625640 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 40/89] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:21:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:48.742137 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:48.743137 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:48.757972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:48.758548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:48.759466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:48.759948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:48.766093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bf69107c-080e-4223-a8b2-8d118653e453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:48.779333 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bf69107c-080e-4223-a8b2-8d118653e453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.635492 May 28 14:21:48.780323 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 50/90] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:48 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:49.258669 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:49.273758 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:49.278507 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:49.279681 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-30702902-aa6d-42e2-ac4f-5aad7777860e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.542848 May 28 14:21:49.280439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 41/91] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:48 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:21:49.339336 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-52616080-f053-4ca4-8817-a10caca10722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5800de57-f9fa-4ca8-9f94-a8880f3c595f", "tag": "9328e999-33b7-4ad7-9796-283089726539"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:49.343196 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:21:49.343196 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:21:49.355569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-52616080-f053-4ca4-8817-a10caca10722 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:49.356924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-52616080-f053-4ca4-8817-a10caca10722 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:49.380797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-52616080-f053-4ca4-8817-a10caca10722 service nova] Creating event network-changed:9328e999-33b7-4ad7-9796-283089726539 for instance 5800de57-f9fa-4ca8-9f94-a8880f3c595f on hv-cinder-79128 May 28 14:21:49.401579 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-52616080-f053-4ca4-8817-a10caca10722 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067492 May 28 14:21:49.402905 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 51/92] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:21:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:21:49.532250 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e5bf6b01-7d05-44e5-8b90-3703542122db tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:49.532872 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e5bf6b01-7d05-44e5-8b90-3703542122db tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:49.544332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e5bf6b01-7d05-44e5-8b90-3703542122db tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:49.548906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e5bf6b01-7d05-44e5-8b90-3703542122db tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:49.548906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e5bf6b01-7d05-44e5-8b90-3703542122db tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:49.548906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e5bf6b01-7d05-44e5-8b90-3703542122db tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:49.797477 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:49.798192 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:49.819240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:49.819738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:49.826406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:49.826880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:50.080910 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e5bf6b01-7d05-44e5-8b90-3703542122db tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:50.093679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e5bf6b01-7d05-44e5-8b90-3703542122db tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.565153 May 28 14:21:50.095473 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 42/93] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:49 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:50.298661 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:50.299456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:50.309223 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:50.309670 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:50.316891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:50.317597 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:50.499312 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:50.515842 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.723249 May 28 14:21:50.519702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 52/94] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:49 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:21:50.559732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:50.569555 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:50.571088 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:50.572210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-206de4a6-091f-45c5-831b-0efdf8bbe38f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.277518 May 28 14:21:50.572766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 43/95] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:50 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:21:51.110573 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1acca2c3-caa6-447f-ae13-312c105010aa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:51.111193 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1acca2c3-caa6-447f-ae13-312c105010aa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:51.119300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1acca2c3-caa6-447f-ae13-312c105010aa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:51.119794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1acca2c3-caa6-447f-ae13-312c105010aa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:51.120566 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1acca2c3-caa6-447f-ae13-312c105010aa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:51.121003 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1acca2c3-caa6-447f-ae13-312c105010aa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:51.333562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1acca2c3-caa6-447f-ae13-312c105010aa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:51.342246 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1acca2c3-caa6-447f-ae13-312c105010aa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.235266 May 28 14:21:51.343100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 53/96] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:51 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:51.533906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cd4ae335-aae2-4687-a320-36a9aab75f8d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:51.534597 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cd4ae335-aae2-4687-a320-36a9aab75f8d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:51.542137 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd4ae335-aae2-4687-a320-36a9aab75f8d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:51.543441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd4ae335-aae2-4687-a320-36a9aab75f8d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:51.543441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd4ae335-aae2-4687-a320-36a9aab75f8d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:51.543894 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd4ae335-aae2-4687-a320-36a9aab75f8d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:51.591149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:51.592192 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:51.600442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:51.601251 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:51.602335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:51.603040 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:51.798177 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cd4ae335-aae2-4687-a320-36a9aab75f8d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:51.808585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cd4ae335-aae2-4687-a320-36a9aab75f8d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.279048 May 28 14:21:51.809384 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 44/97] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:51 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:51.910630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:51.928578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:51.932292 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:51.934026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8d0de6a1-47c9-42ad-b248-0506d34b256f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.347091 May 28 14:21:51.936249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 54/98] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:51 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:52.360249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e97f6037-7d47-445e-9897-8723dd5f60a8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:52.360878 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e97f6037-7d47-445e-9897-8723dd5f60a8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:52.371996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e97f6037-7d47-445e-9897-8723dd5f60a8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:52.371996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e97f6037-7d47-445e-9897-8723dd5f60a8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:52.371996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e97f6037-7d47-445e-9897-8723dd5f60a8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:52.371996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e97f6037-7d47-445e-9897-8723dd5f60a8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:52.617678 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e97f6037-7d47-445e-9897-8723dd5f60a8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:52.626997 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e97f6037-7d47-445e-9897-8723dd5f60a8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.270396 May 28 14:21:52.627619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 45/99] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:52 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:52.827060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:52.828160 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:52.844420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:52.844420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:52.844420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:52.844420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:52.953208 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:52.953831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:52.963660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:52.964124 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:52.974456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:52.974929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:53.174149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:53.183425 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.360810 May 28 14:21:53.192919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 55/100] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:52 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:53.232269 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:53.246377 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:53.246609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:53.248019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cd37c455-f90b-4aab-903c-b1fce1508d11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.298419 May 28 14:21:53.248969 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 46/101] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:52 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:53.644659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a2ca7c13-ca67-481b-b411-477e05cc54ae tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:53.645506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a2ca7c13-ca67-481b-b411-477e05cc54ae tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:53.659184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a2ca7c13-ca67-481b-b411-477e05cc54ae tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:53.659681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a2ca7c13-ca67-481b-b411-477e05cc54ae tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:53.661773 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a2ca7c13-ca67-481b-b411-477e05cc54ae tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:53.662590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a2ca7c13-ca67-481b-b411-477e05cc54ae tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:53.950418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a2ca7c13-ca67-481b-b411-477e05cc54ae tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:53.962545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a2ca7c13-ca67-481b-b411-477e05cc54ae tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.322341 May 28 14:21:53.963133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 56/102] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:53 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:54.200779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-55684b8e-ad61-444f-b60a-17f31b08ecb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:54.202113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-55684b8e-ad61-444f-b60a-17f31b08ecb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:54.224605 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-55684b8e-ad61-444f-b60a-17f31b08ecb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:54.229728 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-55684b8e-ad61-444f-b60a-17f31b08ecb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:54.245889 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-55684b8e-ad61-444f-b60a-17f31b08ecb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:54.246914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-55684b8e-ad61-444f-b60a-17f31b08ecb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:54.338838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-c7238b6c-3d22-4514-8d6f-2310e452bdb5 req-cec959f7-5dd3-4fd4-bd20-6b445a634cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da8b01f-1c47-4118-bc09-bffde9f331b7", "name": "network-vif-plugged", "status": "completed", "tag": "6bfc4f29-c29d-4098-8314-02d1e6aa02a9"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:54.341591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:21:54.341591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:21:54.362892 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-c7238b6c-3d22-4514-8d6f-2310e452bdb5 req-cec959f7-5dd3-4fd4-bd20-6b445a634cda service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:54.364633 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-c7238b6c-3d22-4514-8d6f-2310e452bdb5 req-cec959f7-5dd3-4fd4-bd20-6b445a634cda service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:54.424848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-c7238b6c-3d22-4514-8d6f-2310e452bdb5 req-cec959f7-5dd3-4fd4-bd20-6b445a634cda service nova] Creating event network-vif-plugged:6bfc4f29-c29d-4098-8314-02d1e6aa02a9 for instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 on hv-cinder-79128 May 28 14:21:54.434338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-c7238b6c-3d22-4514-8d6f-2310e452bdb5 req-cec959f7-5dd3-4fd4-bd20-6b445a634cda service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216539 May 28 14:21:54.434952 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 57/103] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:21:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:21:54.462424 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:54.468166 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:54.487529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:54.488021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:54.489148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:54.507926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:54.642895 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-55684b8e-ad61-444f-b60a-17f31b08ecb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:54.653592 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-55684b8e-ad61-444f-b60a-17f31b08ecb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.456668 May 28 14:21:54.654641 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 47/104] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:54 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:54.914167 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:54.926990 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:54.930351 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:54.932262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ab9094da-fac0-4ab7-9637-b5799cea1e19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.495831 May 28 14:21:54.933062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 58/105] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:54 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:21:54.984411 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:54.985394 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:54.994412 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:54.995058 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:54.995979 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:54.996496 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:55.250154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:55.271353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.294339 May 28 14:21:55.274076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 48/106] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:54 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:55.672422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e08898b1-3e2b-470c-861c-07ee389e8713 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:55.673402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e08898b1-3e2b-470c-861c-07ee389e8713 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:55.690351 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e08898b1-3e2b-470c-861c-07ee389e8713 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:55.692263 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e08898b1-3e2b-470c-861c-07ee389e8713 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:55.692263 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e08898b1-3e2b-470c-861c-07ee389e8713 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:55.693987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e08898b1-3e2b-470c-861c-07ee389e8713 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:55.954332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:55.955032 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:55.974546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:55.975226 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:55.976434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:55.977494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:56.038252 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e08898b1-3e2b-470c-861c-07ee389e8713 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:56.057279 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e08898b1-3e2b-470c-861c-07ee389e8713 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.388772 May 28 14:21:56.058219 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 59/107] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:55 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:56.283660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:56.290805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:56.292895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:56.294892 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:56.296467 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:56.297571 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.350012 May 28 14:21:56.298130 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 49/108] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:55 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:21:56.304215 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:56.304680 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:56.305504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:56.308436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:56.453279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-86311b4c-4167-4981-8679-53d02438ad1a req-8c952400-9452-4086-9481-13c960f53412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c17d712-c03d-44ac-bd8d-5f9b99160b0f", "name": "network-vif-plugged", "status": "completed", "tag": "a600bf0f-8706-4c30-ae48-005a0b8b9b84"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:56.455010 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:21:56.455010 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:21:56.463543 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-86311b4c-4167-4981-8679-53d02438ad1a req-8c952400-9452-4086-9481-13c960f53412 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:56.463993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-86311b4c-4167-4981-8679-53d02438ad1a req-8c952400-9452-4086-9481-13c960f53412 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:56.481459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-86311b4c-4167-4981-8679-53d02438ad1a req-8c952400-9452-4086-9481-13c960f53412 service nova] Creating event network-vif-plugged:a600bf0f-8706-4c30-ae48-005a0b8b9b84 for instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f on hv-cinder-79128 May 28 14:21:56.492330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-86311b4c-4167-4981-8679-53d02438ad1a req-8c952400-9452-4086-9481-13c960f53412 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036898 May 28 14:21:56.492330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 50/109] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:21:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:21:56.548485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:56.572847 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.285545 May 28 14:21:56.574926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 60/110] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:56 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:57.075796 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:57.076520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:57.084632 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:57.085081 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:57.085879 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:57.086322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:57.315865 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:57.317688 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:57.325707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:57.326318 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:57.327928 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:57.328708 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:57.384896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:57.396012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.323813 May 28 14:21:57.409055 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 51/111] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:57 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:57.592964 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:57.595113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:57.600533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:57.606081 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:57.606704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:57.607629 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:57.608560 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:57.620832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:57.622382 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:57.623500 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.311356 May 28 14:21:57.628709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 61/112] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:57 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:21:57.924674 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:57.934387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1314 microversion: 2.1 time: 0.347531 May 28 14:21:57.935745 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 52/113] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:57 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:58.414343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-19c46ba7-459a-4fd0-a4ec-419087274682 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:58.414959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-19c46ba7-459a-4fd0-a4ec-419087274682 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:58.423146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19c46ba7-459a-4fd0-a4ec-419087274682 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:58.424111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19c46ba7-459a-4fd0-a4ec-419087274682 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:58.425233 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19c46ba7-459a-4fd0-a4ec-419087274682 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:58.426180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19c46ba7-459a-4fd0-a4ec-419087274682 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:58.646103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:58.647593 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:58.654430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:58.654886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:58.655733 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:58.656128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:58.775996 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-19c46ba7-459a-4fd0-a4ec-419087274682 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:58.785413 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-19c46ba7-459a-4fd0-a4ec-419087274682 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.374959 May 28 14:21:58.797042 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 62/114] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:58 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:58.903381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:58.912747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:58.914432 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:58.915602 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e30c731e-6ae1-48eb-9eb0-494b06642996 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.273891 May 28 14:21:58.916147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 53/115] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:58 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:21:58.949991 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:58.950816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:58.962270 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:58.962740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:58.963572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:58.964021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:59.358129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:21:59.369036 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1500 microversion: 2.1 time: 0.422300 May 28 14:21:59.380825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 63/116] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:58 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:21:59.836988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d8768276-4498-45d9-8af8-4611d7c8e335 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:59.837631 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d8768276-4498-45d9-8af8-4611d7c8e335 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:59.838050 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-495d55d6-fc69-4914-b0ca-6eba80337726 req-9f105195-1469-4428-9fa5-347e4508854d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5800de57-f9fa-4ca8-9f94-a8880f3c595f", "name": "network-vif-plugged", "status": "completed", "tag": "9328e999-33b7-4ad7-9796-283089726539"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:21:59.843297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:21:59.843297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:21:59.880059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-495d55d6-fc69-4914-b0ca-6eba80337726 req-9f105195-1469-4428-9fa5-347e4508854d service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:59.880523 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-495d55d6-fc69-4914-b0ca-6eba80337726 req-9f105195-1469-4428-9fa5-347e4508854d service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:59.884479 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8768276-4498-45d9-8af8-4611d7c8e335 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:59.890534 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8768276-4498-45d9-8af8-4611d7c8e335 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:59.891405 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8768276-4498-45d9-8af8-4611d7c8e335 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:59.891908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8768276-4498-45d9-8af8-4611d7c8e335 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:59.916527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-495d55d6-fc69-4914-b0ca-6eba80337726 req-9f105195-1469-4428-9fa5-347e4508854d service nova] Creating event network-vif-plugged:9328e999-33b7-4ad7-9796-283089726539 for instance 5800de57-f9fa-4ca8-9f94-a8880f3c595f on hv-cinder-79128 May 28 14:21:59.921855 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-495d55d6-fc69-4914-b0ca-6eba80337726 req-9f105195-1469-4428-9fa5-347e4508854d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102924 May 28 14:21:59.923271 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 64/117] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:21:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:21:59.934733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:21:59.937526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:21:59.951974 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:59.952438 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:59.953246 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:59.954436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:00.285363 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:00.289580 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d8768276-4498-45d9-8af8-4611d7c8e335 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:00.299266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d8768276-4498-45d9-8af8-4611d7c8e335 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.497540 May 28 14:22:00.303973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 54/118] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:21:59 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:00.328732 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:00.330357 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:00.345289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-00a7b204-10f0-4c13-9e81-e19db9e78f8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.415311 May 28 14:22:00.347032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 65/119] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:21:59 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:22:01.316230 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9ab379fd-7303-4731-be35-c43800329b5e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:01.337272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9ab379fd-7303-4731-be35-c43800329b5e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:01.337272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ab379fd-7303-4731-be35-c43800329b5e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:01.337272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ab379fd-7303-4731-be35-c43800329b5e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:01.337272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ab379fd-7303-4731-be35-c43800329b5e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:01.338119 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ab379fd-7303-4731-be35-c43800329b5e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:01.362973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:01.364143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:01.371713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:01.372169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:01.372948 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:01.373389 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:01.585308 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9ab379fd-7303-4731-be35-c43800329b5e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:01.587259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:01.592372 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9ab379fd-7303-4731-be35-c43800329b5e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1321 microversion: 2.1 time: 0.280115 May 28 14:22:01.592985 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 55/120] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:01 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:01.596173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:01.598269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:01.599448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.240433 May 28 14:22:01.600058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 66/121] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:01 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:22:01.937319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-c7352a98-f8ad-4038-a54c-f2cd42b7b8c3 req-a7ce70a1-27a0-41fa-93e0-a92a2d3c40e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c36e73b-e6ab-4203-ada8-e971693460e2", "name": "network-vif-plugged", "status": "completed", "tag": "c2872b93-4077-4bc0-8619-140f73de2a3a"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:01.938991 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:22:01.938991 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:22:01.947427 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-c7352a98-f8ad-4038-a54c-f2cd42b7b8c3 req-a7ce70a1-27a0-41fa-93e0-a92a2d3c40e7 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:01.947977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-c7352a98-f8ad-4038-a54c-f2cd42b7b8c3 req-a7ce70a1-27a0-41fa-93e0-a92a2d3c40e7 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:01.963574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-c7352a98-f8ad-4038-a54c-f2cd42b7b8c3 req-a7ce70a1-27a0-41fa-93e0-a92a2d3c40e7 service nova] Creating event network-vif-plugged:c2872b93-4077-4bc0-8619-140f73de2a3a for instance 2c36e73b-e6ab-4203-ada8-e971693460e2 on hv-cinder-79128 May 28 14:22:01.968687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-c7352a98-f8ad-4038-a54c-f2cd42b7b8c3 req-a7ce70a1-27a0-41fa-93e0-a92a2d3c40e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035154 May 28 14:22:01.969343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 56/122] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:22:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:22:02.022756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b88223db-7446-42b6-ac46-ec65f91cfaa4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9104842c-8566-4afb-a331-fd37e28fc0bd"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:02.024090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b88223db-7446-42b6-ac46-ec65f91cfaa4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:02.031895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b88223db-7446-42b6-ac46-ec65f91cfaa4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:02.032414 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b88223db-7446-42b6-ac46-ec65f91cfaa4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:02.058390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b88223db-7446-42b6-ac46-ec65f91cfaa4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:02.058947 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b88223db-7446-42b6-ac46-ec65f91cfaa4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:02.657792 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ca49e129-6464-40e3-ba1f-be95d466411e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:02.658610 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ca49e129-6464-40e3-ba1f-be95d466411e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:02.678326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca49e129-6464-40e3-ba1f-be95d466411e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:02.681599 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca49e129-6464-40e3-ba1f-be95d466411e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:02.681956 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca49e129-6464-40e3-ba1f-be95d466411e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:02.682772 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca49e129-6464-40e3-ba1f-be95d466411e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:02.916799 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca49e129-6464-40e3-ba1f-be95d466411e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:02.925066 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ca49e129-6464-40e3-ba1f-be95d466411e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1515 microversion: 2.1 time: 0.272213 May 28 14:22:02.925648 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 57/123] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:02 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:02.931063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:02.931708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:02.940715 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:02.941256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:02.942501 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:02.942648 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:03.149165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b88223db-7446-42b6-ac46-ec65f91cfaa4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "POST /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.129969 May 28 14:22:03.150087 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 67/124] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:22:02 2021] POST /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7/os-volume_attachments => generated 194 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:22:03.155715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:03.157794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:03.170750 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:03.171609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:03.175462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:03.175462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:03.231307 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:03.242457 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:03.244591 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:03.246059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f98ae10e-a76c-420c-90b3-1e521ad95924 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.319472 May 28 14:22:03.246846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 58/125] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:02 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:03.266227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lazy-loading 'flavor' on Instance uuid 5800de57-f9fa-4ca8-9f94-a8880f3c595f {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:22:03.708186 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f/action" status: 200 len: 32 microversion: 2.1 time: 0.556138 May 28 14:22:03.709360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 68/126] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:22:03 2021] POST /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f/action => generated 32 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:22:03.718356 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f568841e-ce3f-489a-aec8-204a04ca8ca6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:03.719036 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f568841e-ce3f-489a-aec8-204a04ca8ca6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:03.726391 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f568841e-ce3f-489a-aec8-204a04ca8ca6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:03.728296 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f568841e-ce3f-489a-aec8-204a04ca8ca6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:03.729097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f568841e-ce3f-489a-aec8-204a04ca8ca6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:03.729640 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f568841e-ce3f-489a-aec8-204a04ca8ca6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:03.941544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f568841e-ce3f-489a-aec8-204a04ca8ca6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:03.949873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f568841e-ce3f-489a-aec8-204a04ca8ca6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.235723 May 28 14:22:03.950497 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 59/127] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:03 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:04.269647 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:04.270353 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:04.285281 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:04.290901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:04.290901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:04.290901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:04.496305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:04.506081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:04.507770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:04.510592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.246497 May 28 14:22:04.510592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 69/128] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:04 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:04.967262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-633db146-7978-4971-83f7-452bafb24af6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:04.967894 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-633db146-7978-4971-83f7-452bafb24af6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:04.975973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-633db146-7978-4971-83f7-452bafb24af6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:04.976428 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-633db146-7978-4971-83f7-452bafb24af6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:04.977214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-633db146-7978-4971-83f7-452bafb24af6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:04.977650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-633db146-7978-4971-83f7-452bafb24af6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:05.174029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-633db146-7978-4971-83f7-452bafb24af6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:05.183388 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-633db146-7978-4971-83f7-452bafb24af6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.219799 May 28 14:22:05.183983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 60/129] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:04 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:05.526237 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:05.526957 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:05.534274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:05.534740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:05.535525 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:05.536013 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:05.730778 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:05.740329 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:05.741874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:05.742966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d2e0739a-a747-436b-8343-3bd5365eb767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.220548 May 28 14:22:05.743530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 70/130] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:05 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:06.200672 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-eea89b9b-8781-4217-b783-4d6112dffd42 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:06.201283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-eea89b9b-8781-4217-b783-4d6112dffd42 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:06.209296 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eea89b9b-8781-4217-b783-4d6112dffd42 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:06.209750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eea89b9b-8781-4217-b783-4d6112dffd42 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:06.210563 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eea89b9b-8781-4217-b783-4d6112dffd42 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:06.211042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eea89b9b-8781-4217-b783-4d6112dffd42 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:06.404339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-eea89b9b-8781-4217-b783-4d6112dffd42 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:06.416087 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-eea89b9b-8781-4217-b783-4d6112dffd42 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.219070 May 28 14:22:06.416663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 61/131] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:06 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:06.761193 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:06.762081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:06.769487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:06.770029 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:06.770895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:06.771430 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:06.963900 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:06.972534 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:06.974102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:06.975203 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.217778 May 28 14:22:06.975983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 71/132] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:06 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:07.433353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bbb5ea78-a876-40a5-9aa2-973665609f0c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:07.434016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bbb5ea78-a876-40a5-9aa2-973665609f0c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:07.441661 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea78-a876-40a5-9aa2-973665609f0c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:07.442655 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea78-a876-40a5-9aa2-973665609f0c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:07.443439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea78-a876-40a5-9aa2-973665609f0c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:07.443965 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea78-a876-40a5-9aa2-973665609f0c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:07.648074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bbb5ea78-a876-40a5-9aa2-973665609f0c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:07.656311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bbb5ea78-a876-40a5-9aa2-973665609f0c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.226804 May 28 14:22:07.656888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 62/133] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:07 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:07.993275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:07.994610 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:08.004027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:08.005357 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:08.006204 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:08.006658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:08.398108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:08.407695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:08.409294 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:08.411143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.421453 May 28 14:22:08.411143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 72/134] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:07 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:08.674161 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2e2c3e75-cb40-466a-9948-6653881f69ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:08.674715 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2e2c3e75-cb40-466a-9948-6653881f69ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:08.682660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e2c3e75-cb40-466a-9948-6653881f69ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:08.683119 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e2c3e75-cb40-466a-9948-6653881f69ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:08.683960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e2c3e75-cb40-466a-9948-6653881f69ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:08.684404 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e2c3e75-cb40-466a-9948-6653881f69ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:08.882546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2e2c3e75-cb40-466a-9948-6653881f69ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:08.890904 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2e2c3e75-cb40-466a-9948-6653881f69ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.220582 May 28 14:22:08.891519 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 63/135] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:08 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:09.428967 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:09.429661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:09.437125 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:09.437593 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:09.439070 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:09.439533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:09.637744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:09.647104 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:09.648671 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:09.649794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.225329 May 28 14:22:09.650364 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 73/136] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:09 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:09.907650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b03ee6c9-32f5-45de-8e93-af653b26eab3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:09.908272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b03ee6c9-32f5-45de-8e93-af653b26eab3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:09.916087 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b03ee6c9-32f5-45de-8e93-af653b26eab3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:09.916546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b03ee6c9-32f5-45de-8e93-af653b26eab3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:09.917326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b03ee6c9-32f5-45de-8e93-af653b26eab3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:09.917772 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b03ee6c9-32f5-45de-8e93-af653b26eab3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:10.122581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b03ee6c9-32f5-45de-8e93-af653b26eab3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:10.122896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b03ee6c9-32f5-45de-8e93-af653b26eab3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.218982 May 28 14:22:10.123487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 64/137] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:09 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:10.666439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:10.667095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:10.674575 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:10.675031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:10.675843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:10.676314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:10.866651 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:10.875317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:10.876837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:10.877914 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8d4b084c-3a44-48c3-83e9-e596040da076 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.215280 May 28 14:22:10.878477 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 74/138] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:10 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:11.148008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-74afd548-ce99-477f-88d3-7b9e14ac693f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:11.148008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-74afd548-ce99-477f-88d3-7b9e14ac693f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:11.148943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74afd548-ce99-477f-88d3-7b9e14ac693f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:11.149406 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74afd548-ce99-477f-88d3-7b9e14ac693f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:11.150197 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74afd548-ce99-477f-88d3-7b9e14ac693f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:11.150641 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74afd548-ce99-477f-88d3-7b9e14ac693f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:11.355734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-74afd548-ce99-477f-88d3-7b9e14ac693f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:11.364630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-74afd548-ce99-477f-88d3-7b9e14ac693f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.227007 May 28 14:22:11.365251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 65/139] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:11 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:11.896253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:11.896868 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:11.904312 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:11.904770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:11.905549 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:11.906093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:12.159419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:12.163404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:12.164981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:12.166119 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-aac0527a-759c-4af0-adce-e38a4ac6425f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.274281 May 28 14:22:12.166805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 75/140] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:11 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:12.381899 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7c824a5d-f45a-4737-8a0a-f26a91da077a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:12.382527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7c824a5d-f45a-4737-8a0a-f26a91da077a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:12.389873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7c824a5d-f45a-4737-8a0a-f26a91da077a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:12.390447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7c824a5d-f45a-4737-8a0a-f26a91da077a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:12.391188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7c824a5d-f45a-4737-8a0a-f26a91da077a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:12.391673 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7c824a5d-f45a-4737-8a0a-f26a91da077a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:12.589857 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7c824a5d-f45a-4737-8a0a-f26a91da077a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:12.598793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7c824a5d-f45a-4737-8a0a-f26a91da077a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.220560 May 28 14:22:12.599381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 66/141] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:12 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:13.184598 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:13.185209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:13.192671 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:13.193128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:13.193903 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:13.194342 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:13.389109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:13.398408 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:13.400076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:13.401545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1406 microversion: 2.20 time: 0.220718 May 28 14:22:13.402106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 76/142] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:13 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:13.615915 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f4dfef77-b509-420a-9785-f9baddfae39a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:13.616544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f4dfef77-b509-420a-9785-f9baddfae39a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:13.623845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4dfef77-b509-420a-9785-f9baddfae39a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:13.624304 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4dfef77-b509-420a-9785-f9baddfae39a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:13.625091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4dfef77-b509-420a-9785-f9baddfae39a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:13.625538 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4dfef77-b509-420a-9785-f9baddfae39a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:13.846990 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f4dfef77-b509-420a-9785-f9baddfae39a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:13.855419 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f4dfef77-b509-420a-9785-f9baddfae39a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.243460 May 28 14:22:13.856040 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 67/143] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:13 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:14.419358 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:14.420006 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:14.427316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:14.427812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:14.428592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:14.429029 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:14.627326 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:14.636307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:14.638002 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:14.639188 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c81e32cb-6629-4c18-9116-98406dd28501 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1598 microversion: 2.20 time: 0.223538 May 28 14:22:14.639973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 77/144] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:22:14 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1598 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:22:14.657818 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:14.658330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:14.667027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:14.670073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:14.670073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:14.670073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:14.827714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.167646 May 28 14:22:14.827714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 68/145] 10.222.0.59 () {60 vars in 1316 bytes} [Fri May 28 14:22:14 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:22:14.873212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:14.873931 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:14.883670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:14.883670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:14.884286 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:14.884879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:15.090126 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:15.099176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.229742 May 28 14:22:15.099781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 78/146] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:14 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:16.115872 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-701795c1-dd06-4ac4-8e19-e226fa2c66de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:16.116489 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-701795c1-dd06-4ac4-8e19-e226fa2c66de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:16.123950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-701795c1-dd06-4ac4-8e19-e226fa2c66de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:16.124345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-701795c1-dd06-4ac4-8e19-e226fa2c66de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:16.125126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-701795c1-dd06-4ac4-8e19-e226fa2c66de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:16.125566 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-701795c1-dd06-4ac4-8e19-e226fa2c66de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:16.641479 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-701795c1-dd06-4ac4-8e19-e226fa2c66de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:16.653532 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-701795c1-dd06-4ac4-8e19-e226fa2c66de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.541667 May 28 14:22:16.656147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 69/147] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:16 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:16.800291 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-985e26cc-d294-4984-a9f3-cba5a611006e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:16.806489 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-9918c634-881e-40e7-9774-e4f44f9ef584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c36e73b-e6ab-4203-ada8-e971693460e2", "tag": "c2872b93-4077-4bc0-8619-140f73de2a3a"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:16.808437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-985e26cc-d294-4984-a9f3-cba5a611006e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:16.809300 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:22:16.809300 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:22:16.826305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-9918c634-881e-40e7-9774-e4f44f9ef584 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:16.826305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-9918c634-881e-40e7-9774-e4f44f9ef584 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:16.829010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-985e26cc-d294-4984-a9f3-cba5a611006e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:16.829482 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-985e26cc-d294-4984-a9f3-cba5a611006e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:16.830310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-985e26cc-d294-4984-a9f3-cba5a611006e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:16.830769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-985e26cc-d294-4984-a9f3-cba5a611006e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:16.845608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-9918c634-881e-40e7-9774-e4f44f9ef584 service nova] Creating event network-changed:c2872b93-4077-4bc0-8619-140f73de2a3a for instance 2c36e73b-e6ab-4203-ada8-e971693460e2 on hv-cinder-79128 May 28 14:22:16.852748 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-9918c634-881e-40e7-9774-e4f44f9ef584 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049860 May 28 14:22:16.854145 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 70/148] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:22:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:22:17.673414 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5a344210-8835-4df6-b1a5-6d79b1911c7b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:17.674063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5a344210-8835-4df6-b1a5-6d79b1911c7b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:17.681922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5a344210-8835-4df6-b1a5-6d79b1911c7b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:17.682380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5a344210-8835-4df6-b1a5-6d79b1911c7b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:17.683161 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5a344210-8835-4df6-b1a5-6d79b1911c7b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:17.683849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5a344210-8835-4df6-b1a5-6d79b1911c7b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:17.888619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5a344210-8835-4df6-b1a5-6d79b1911c7b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:17.897040 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5a344210-8835-4df6-b1a5-6d79b1911c7b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.227929 May 28 14:22:17.897623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 71/149] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:17 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:18.913920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d8839539-6056-4be5-8217-bd459c8de3fe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:18.914576 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d8839539-6056-4be5-8217-bd459c8de3fe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:18.921880 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8839539-6056-4be5-8217-bd459c8de3fe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:18.922377 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8839539-6056-4be5-8217-bd459c8de3fe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:18.923159 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8839539-6056-4be5-8217-bd459c8de3fe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:18.923692 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8839539-6056-4be5-8217-bd459c8de3fe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:19.122688 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d8839539-6056-4be5-8217-bd459c8de3fe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:19.131021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d8839539-6056-4be5-8217-bd459c8de3fe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.221703 May 28 14:22:19.131678 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 72/150] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:18 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:20.148682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:20.149314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:20.156498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:20.156950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:20.157722 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:20.158160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:20.356302 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:20.365570 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.221250 May 28 14:22:20.366157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 73/151] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:20 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:20.663318 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-985e26cc-d294-4984-a9f3-cba5a611006e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 3.866520 May 28 14:22:20.664227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 79/152] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:16 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 3868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:21.382285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-805c63a8-e342-44c3-be07-5c8ddc070ff7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:21.382932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-805c63a8-e342-44c3-be07-5c8ddc070ff7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:21.390292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-805c63a8-e342-44c3-be07-5c8ddc070ff7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:21.390838 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-805c63a8-e342-44c3-be07-5c8ddc070ff7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:21.391752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-805c63a8-e342-44c3-be07-5c8ddc070ff7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:21.392206 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-805c63a8-e342-44c3-be07-5c8ddc070ff7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:21.588260 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-805c63a8-e342-44c3-be07-5c8ddc070ff7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:21.596674 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-805c63a8-e342-44c3-be07-5c8ddc070ff7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.218297 May 28 14:22:21.597470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 74/153] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:21 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:21.675536 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-eaa55477-3146-4fba-9769-7c81dc2ee8be tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:21.677075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-eaa55477-3146-4fba-9769-7c81dc2ee8be tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:21.685953 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eaa55477-3146-4fba-9769-7c81dc2ee8be tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:21.686441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eaa55477-3146-4fba-9769-7c81dc2ee8be tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:21.687269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eaa55477-3146-4fba-9769-7c81dc2ee8be tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:21.687794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eaa55477-3146-4fba-9769-7c81dc2ee8be tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:21.815083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-eaa55477-3146-4fba-9769-7c81dc2ee8be tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 0.143696 May 28 14:22:21.818401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 80/154] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:21 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:22.614425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-088c807b-f181-4cc0-a5aa-e442f068b749 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:22.615051 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-088c807b-f181-4cc0-a5aa-e442f068b749 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:22.622840 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-088c807b-f181-4cc0-a5aa-e442f068b749 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:22.623306 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-088c807b-f181-4cc0-a5aa-e442f068b749 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:22.624145 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-088c807b-f181-4cc0-a5aa-e442f068b749 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:22.624596 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-088c807b-f181-4cc0-a5aa-e442f068b749 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:22.826984 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-41435b60-ace5-4d5a-9e4c-7f56691d0976 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:22.828256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-41435b60-ace5-4d5a-9e4c-7f56691d0976 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:22.831179 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-088c807b-f181-4cc0-a5aa-e442f068b749 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:22.836802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-41435b60-ace5-4d5a-9e4c-7f56691d0976 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:22.837258 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-41435b60-ace5-4d5a-9e4c-7f56691d0976 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:22.838099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-41435b60-ace5-4d5a-9e4c-7f56691d0976 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:22.838568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-41435b60-ace5-4d5a-9e4c-7f56691d0976 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:22.840044 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-088c807b-f181-4cc0-a5aa-e442f068b749 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.230191 May 28 14:22:22.840621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 75/155] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:22 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:22.970366 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-41435b60-ace5-4d5a-9e4c-7f56691d0976 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 0.147370 May 28 14:22:22.973655 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 81/156] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:22 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:23.857528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:23.858160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:23.877853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:23.879802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:23.879802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:23.882915 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:23.981682 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b6ee1d9a-513d-4e53-b278-65cef9355ce8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:23.982781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b6ee1d9a-513d-4e53-b278-65cef9355ce8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:23.993448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d9a-513d-4e53-b278-65cef9355ce8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:24.000133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d9a-513d-4e53-b278-65cef9355ce8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:24.000133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d9a-513d-4e53-b278-65cef9355ce8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:24.000133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d9a-513d-4e53-b278-65cef9355ce8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:24.159179 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:24.159573 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b6ee1d9a-513d-4e53-b278-65cef9355ce8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 0.181214 May 28 14:22:24.160360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 82/157] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:23 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:24.164954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.311313 May 28 14:22:24.165688 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 76/158] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:23 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:25.171193 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c76f3c3a-691d-49f7-a4ed-8cd18f347c3d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:25.172243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c76f3c3a-691d-49f7-a4ed-8cd18f347c3d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:25.181505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c76f3c3a-691d-49f7-a4ed-8cd18f347c3d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:25.181970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c76f3c3a-691d-49f7-a4ed-8cd18f347c3d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:25.182661 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0af0d124-dd60-486f-b09d-9c9688f114e8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:25.183108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c76f3c3a-691d-49f7-a4ed-8cd18f347c3d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:25.183209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c76f3c3a-691d-49f7-a4ed-8cd18f347c3d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:25.183434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0af0d124-dd60-486f-b09d-9c9688f114e8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:25.192551 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0af0d124-dd60-486f-b09d-9c9688f114e8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:25.193248 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0af0d124-dd60-486f-b09d-9c9688f114e8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:25.194197 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0af0d124-dd60-486f-b09d-9c9688f114e8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:25.194801 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0af0d124-dd60-486f-b09d-9c9688f114e8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:25.406868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0af0d124-dd60-486f-b09d-9c9688f114e8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:25.415302 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0af0d124-dd60-486f-b09d-9c9688f114e8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.236858 May 28 14:22:25.415901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 77/159] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:25 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:26.433282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-75af9630-810e-4cbb-b01e-1a2776de2429 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:26.433989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-75af9630-810e-4cbb-b01e-1a2776de2429 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:26.441711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-75af9630-810e-4cbb-b01e-1a2776de2429 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:26.448439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-75af9630-810e-4cbb-b01e-1a2776de2429 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:26.448439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-75af9630-810e-4cbb-b01e-1a2776de2429 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:26.448439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-75af9630-810e-4cbb-b01e-1a2776de2429 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:26.652314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-75af9630-810e-4cbb-b01e-1a2776de2429 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:26.662032 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-75af9630-810e-4cbb-b01e-1a2776de2429 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.233343 May 28 14:22:26.662619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 78/160] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:26 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:27.678650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:27.679305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:27.686883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:27.687346 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:27.688156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:27.688597 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:28.034943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:28.047367 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.372378 May 28 14:22:28.057328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 79/161] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:27 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:29.064464 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-60dedccb-f348-4c4d-a88e-80e0ff72d458 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:29.065081 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-60dedccb-f348-4c4d-a88e-80e0ff72d458 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:29.072452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60dedccb-f348-4c4d-a88e-80e0ff72d458 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:29.072917 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60dedccb-f348-4c4d-a88e-80e0ff72d458 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:29.073708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60dedccb-f348-4c4d-a88e-80e0ff72d458 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:29.074160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60dedccb-f348-4c4d-a88e-80e0ff72d458 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:29.275671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-60dedccb-f348-4c4d-a88e-80e0ff72d458 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:29.285439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-60dedccb-f348-4c4d-a88e-80e0ff72d458 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.223446 May 28 14:22:29.285558 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 80/162] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:29 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:29.854061 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c76f3c3a-691d-49f7-a4ed-8cd18f347c3d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 4.687082 May 28 14:22:29.857307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 83/163] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:25 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 4689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:30.302408 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:30.303056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:30.312341 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:30.312341 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:30.312843 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:30.313770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:30.586362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:30.594756 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.296515 May 28 14:22:30.595256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 81/164] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:30 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:30.866813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-97d9a2af-a470-4aea-89a5-00ab735c3dc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:30.867863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-97d9a2af-a470-4aea-89a5-00ab735c3dc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:30.876224 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-97d9a2af-a470-4aea-89a5-00ab735c3dc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:30.876689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-97d9a2af-a470-4aea-89a5-00ab735c3dc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:30.877509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-97d9a2af-a470-4aea-89a5-00ab735c3dc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:30.877959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-97d9a2af-a470-4aea-89a5-00ab735c3dc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:31.001361 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-97d9a2af-a470-4aea-89a5-00ab735c3dc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 0.139618 May 28 14:22:31.002200 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 84/165] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:30 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:31.611161 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a643635c-7725-4eb9-94e1-f9b6f622222b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:31.612502 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a643635c-7725-4eb9-94e1-f9b6f622222b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:31.626881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a643635c-7725-4eb9-94e1-f9b6f622222b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:31.626881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a643635c-7725-4eb9-94e1-f9b6f622222b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:31.626881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a643635c-7725-4eb9-94e1-f9b6f622222b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:31.626881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a643635c-7725-4eb9-94e1-f9b6f622222b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:31.840850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a643635c-7725-4eb9-94e1-f9b6f622222b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:31.849338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a643635c-7725-4eb9-94e1-f9b6f622222b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.242279 May 28 14:22:31.849974 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 82/166] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:31 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:32.013372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-124ebc5a-8f30-41c6-80c1-8f17233ef0e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:32.014385 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-124ebc5a-8f30-41c6-80c1-8f17233ef0e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:32.022341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-124ebc5a-8f30-41c6-80c1-8f17233ef0e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:32.022797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-124ebc5a-8f30-41c6-80c1-8f17233ef0e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:32.023599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-124ebc5a-8f30-41c6-80c1-8f17233ef0e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:32.024048 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-124ebc5a-8f30-41c6-80c1-8f17233ef0e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:32.897845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:32.897845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:32.897845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:32.897845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:32.900231 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:32.900231 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:33.072655 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:33.080925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.218583 May 28 14:22:33.081499 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 83/167] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:32 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:34.097733 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-53e855b6-5d72-4065-a61e-94fed93c0ff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:34.098529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-53e855b6-5d72-4065-a61e-94fed93c0ff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:34.105811 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-53e855b6-5d72-4065-a61e-94fed93c0ff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:34.106271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-53e855b6-5d72-4065-a61e-94fed93c0ff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:34.107052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-53e855b6-5d72-4065-a61e-94fed93c0ff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:34.107491 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-53e855b6-5d72-4065-a61e-94fed93c0ff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:34.306941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-53e855b6-5d72-4065-a61e-94fed93c0ff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:34.317078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-53e855b6-5d72-4065-a61e-94fed93c0ff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.221086 May 28 14:22:34.317078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 84/168] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:34 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:35.332813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:35.333528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:35.341148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:35.341673 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:35.342460 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:35.342897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:35.547224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:35.553337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.224878 May 28 14:22:35.553985 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 85/169] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:35 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:36.570021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:36.570705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:36.577774 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:36.578171 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:36.578948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:36.579390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:36.778080 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:36.786803 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.220450 May 28 14:22:36.787364 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 86/170] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:36 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:37.314181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-124ebc5a-8f30-41c6-80c1-8f17233ef0e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 5.305297 May 28 14:22:37.314824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 85/171] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:32 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 5307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:37.803583 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-30875401-0c32-407e-99ab-9f68d8fcf7d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:37.804375 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-30875401-0c32-407e-99ab-9f68d8fcf7d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:37.811863 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-30875401-0c32-407e-99ab-9f68d8fcf7d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:37.812323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-30875401-0c32-407e-99ab-9f68d8fcf7d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:37.813117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-30875401-0c32-407e-99ab-9f68d8fcf7d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:37.813559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-30875401-0c32-407e-99ab-9f68d8fcf7d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:38.009084 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-30875401-0c32-407e-99ab-9f68d8fcf7d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:38.017362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-30875401-0c32-407e-99ab-9f68d8fcf7d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.218135 May 28 14:22:38.017927 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 87/172] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:37 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:38.325676 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8dd5bbb0-303e-4ef0-9aaa-b5ac4986109e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:38.326742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8dd5bbb0-303e-4ef0-9aaa-b5ac4986109e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:38.334745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8dd5bbb0-303e-4ef0-9aaa-b5ac4986109e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:38.335209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8dd5bbb0-303e-4ef0-9aaa-b5ac4986109e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:38.336084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8dd5bbb0-303e-4ef0-9aaa-b5ac4986109e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:38.336538 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8dd5bbb0-303e-4ef0-9aaa-b5ac4986109e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:38.538335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8dd5bbb0-303e-4ef0-9aaa-b5ac4986109e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 0.216690 May 28 14:22:38.541500 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 86/173] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:38 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:39.038784 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a3b9bf6c-06f2-4135-8930-a831489930f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:39.039442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a3b9bf6c-06f2-4135-8930-a831489930f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:39.046852 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a3b9bf6c-06f2-4135-8930-a831489930f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:39.047312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a3b9bf6c-06f2-4135-8930-a831489930f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:39.048129 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a3b9bf6c-06f2-4135-8930-a831489930f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:39.048575 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a3b9bf6c-06f2-4135-8930-a831489930f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:39.251129 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a3b9bf6c-06f2-4135-8930-a831489930f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:39.260686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a3b9bf6c-06f2-4135-8930-a831489930f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.226154 May 28 14:22:39.261365 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 88/174] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:39 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:39.551198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8c487595-2db2-4f2b-bd6d-a94865dd62cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:39.552360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8c487595-2db2-4f2b-bd6d-a94865dd62cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:39.560521 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c487595-2db2-4f2b-bd6d-a94865dd62cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:39.560999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c487595-2db2-4f2b-bd6d-a94865dd62cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:39.561777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c487595-2db2-4f2b-bd6d-a94865dd62cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:39.562216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c487595-2db2-4f2b-bd6d-a94865dd62cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:39.696140 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8c487595-2db2-4f2b-bd6d-a94865dd62cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 14 microversion: 2.20 time: 0.150230 May 28 14:22:39.696715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 87/175] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:39 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:40.278283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3dd09622-65a0-49ae-b733-a4445f446861 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:40.279730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3dd09622-65a0-49ae-b733-a4445f446861 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:40.286747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3dd09622-65a0-49ae-b733-a4445f446861 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:40.287204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3dd09622-65a0-49ae-b733-a4445f446861 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:40.288035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3dd09622-65a0-49ae-b733-a4445f446861 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:40.288481 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3dd09622-65a0-49ae-b733-a4445f446861 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:40.407195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:40.408032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:40.416689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:40.417468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:40.418473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:40.418988 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:40.485294 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:22:40.496792 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3dd09622-65a0-49ae-b733-a4445f446861 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:40.506996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3dd09622-65a0-49ae-b733-a4445f446861 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.232581 May 28 14:22:40.509720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 89/176] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:40 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:40.706479 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a31fc2e5-b4af-4aaf-aa38-0597d94c922c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:40.707437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a31fc2e5-b4af-4aaf-aa38-0597d94c922c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:40.714823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a31fc2e5-b4af-4aaf-aa38-0597d94c922c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:40.716312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a31fc2e5-b4af-4aaf-aa38-0597d94c922c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:40.716312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a31fc2e5-b4af-4aaf-aa38-0597d94c922c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:40.716592 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a31fc2e5-b4af-4aaf-aa38-0597d94c922c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:40.927029 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 204 len: 0 microversion: 2.1 time: 0.523960 May 28 14:22:40.927736 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 88/177] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:22:40 2021] DELETE /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 14:22:40.935949 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f80e56f6-6517-438d-be47-09cbdcccbbcb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:40.936660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f80e56f6-6517-438d-be47-09cbdcccbbcb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:40.945404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f80e56f6-6517-438d-be47-09cbdcccbbcb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:40.945863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f80e56f6-6517-438d-be47-09cbdcccbbcb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:40.946699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f80e56f6-6517-438d-be47-09cbdcccbbcb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:40.947146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f80e56f6-6517-438d-be47-09cbdcccbbcb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:41.151000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f80e56f6-6517-438d-be47-09cbdcccbbcb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:41.160033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f80e56f6-6517-438d-be47-09cbdcccbbcb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.227981 May 28 14:22:41.160641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 89/178] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:40 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:41.524654 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8b4e2883-a043-496d-a82f-353b07532db9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:41.525270 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8b4e2883-a043-496d-a82f-353b07532db9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:41.533009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b4e2883-a043-496d-a82f-353b07532db9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:41.533464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b4e2883-a043-496d-a82f-353b07532db9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:41.534276 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b4e2883-a043-496d-a82f-353b07532db9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:41.535350 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b4e2883-a043-496d-a82f-353b07532db9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:41.736168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8b4e2883-a043-496d-a82f-353b07532db9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:41.744932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8b4e2883-a043-496d-a82f-353b07532db9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.224008 May 28 14:22:41.745502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 90/179] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:41 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:42.177254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:42.177871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:42.185211 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:42.191315 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:42.191315 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:42.191315 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:42.388243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:42.406306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.233204 May 28 14:22:42.407030 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 91/180] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:42 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:42.762191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:42.762815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:42.770235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:42.770698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:42.771483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:42.771961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:42.972423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:42.980761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.222397 May 28 14:22:42.981324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 92/181] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:42 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:43.423472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c1b8f771-2c81-484d-a0b9-69205d537caa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:43.424184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c1b8f771-2c81-484d-a0b9-69205d537caa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:43.431490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1b8f771-2c81-484d-a0b9-69205d537caa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:43.431983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1b8f771-2c81-484d-a0b9-69205d537caa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:43.432770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1b8f771-2c81-484d-a0b9-69205d537caa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:43.433218 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1b8f771-2c81-484d-a0b9-69205d537caa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:43.642259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c1b8f771-2c81-484d-a0b9-69205d537caa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:43.651582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c1b8f771-2c81-484d-a0b9-69205d537caa tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.231858 May 28 14:22:43.652134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 93/182] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:43 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:43.674882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a31fc2e5-b4af-4aaf-aa38-0597d94c922c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 15753 microversion: 2.20 time: 2.972112 May 28 14:22:43.676068 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 90/183] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:40 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 15753 bytes in 2974 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:22:43.997989 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f9756595-958f-451a-babd-cb3ddc5a4480 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:43.998600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f9756595-958f-451a-babd-cb3ddc5a4480 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:44.006659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9756595-958f-451a-babd-cb3ddc5a4480 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:44.007109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9756595-958f-451a-babd-cb3ddc5a4480 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:44.007908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9756595-958f-451a-babd-cb3ddc5a4480 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:44.008347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9756595-958f-451a-babd-cb3ddc5a4480 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:44.200260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f9756595-958f-451a-babd-cb3ddc5a4480 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:44.209140 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f9756595-958f-451a-babd-cb3ddc5a4480 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.214801 May 28 14:22:44.209917 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 94/184] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:43 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:44.669090 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6737d3eb-21d2-425b-b22c-c352cce70cca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:44.669973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6737d3eb-21d2-425b-b22c-c352cce70cca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:44.678778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6737d3eb-21d2-425b-b22c-c352cce70cca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:44.679373 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6737d3eb-21d2-425b-b22c-c352cce70cca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:44.683097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6737d3eb-21d2-425b-b22c-c352cce70cca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:44.683097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6737d3eb-21d2-425b-b22c-c352cce70cca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:44.689080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f4358c00-d3ac-45b8-97a1-aa03f3318f40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:44.690458 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f4358c00-d3ac-45b8-97a1-aa03f3318f40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:44.698593 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f4358c00-d3ac-45b8-97a1-aa03f3318f40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:44.699054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f4358c00-d3ac-45b8-97a1-aa03f3318f40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:44.699867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f4358c00-d3ac-45b8-97a1-aa03f3318f40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:44.700473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f4358c00-d3ac-45b8-97a1-aa03f3318f40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:44.891099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6737d3eb-21d2-425b-b22c-c352cce70cca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:44.900308 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6737d3eb-21d2-425b-b22c-c352cce70cca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.236022 May 28 14:22:44.900879 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 91/185] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:44 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:45.225938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:45.226802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:45.234235 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:45.234695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:45.235477 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:45.235952 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:45.435646 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:45.443913 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.221718 May 28 14:22:45.444476 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 92/186] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:45 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:45.917596 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:45.918335 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:45.926303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:45.926756 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:45.927581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:45.928039 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:46.125440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:46.134720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.220770 May 28 14:22:46.135284 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 93/187] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:45 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:46.461309 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-70e05242-8712-4793-be7a-fa921f5bbfbd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:46.469216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-70e05242-8712-4793-be7a-fa921f5bbfbd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:46.469216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70e05242-8712-4793-be7a-fa921f5bbfbd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:46.469607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70e05242-8712-4793-be7a-fa921f5bbfbd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:46.470394 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70e05242-8712-4793-be7a-fa921f5bbfbd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:46.470840 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70e05242-8712-4793-be7a-fa921f5bbfbd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:46.666400 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-70e05242-8712-4793-be7a-fa921f5bbfbd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:46.675301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-70e05242-8712-4793-be7a-fa921f5bbfbd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.217761 May 28 14:22:46.675916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 94/188] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:46 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:46.873607 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f4358c00-d3ac-45b8-97a1-aa03f3318f40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 19342 microversion: 2.20 time: 2.189352 May 28 14:22:46.877259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 95/189] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:44 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 19342 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:22:47.151450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:47.152107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:47.160079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:47.160680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:47.161463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:47.161907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:47.357253 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:47.366736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.219110 May 28 14:22:47.367965 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 95/190] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:47 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:47.693102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:47.693733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:47.701807 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:47.705158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:47.705158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:47.705158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:47.884316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-52ad6e6e-cc0c-4cd6-a5c9-34edddbb465f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:47.889586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-52ad6e6e-cc0c-4cd6-a5c9-34edddbb465f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:47.897100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-52ad6e6e-cc0c-4cd6-a5c9-34edddbb465f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:47.897560 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-52ad6e6e-cc0c-4cd6-a5c9-34edddbb465f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:47.898350 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-52ad6e6e-cc0c-4cd6-a5c9-34edddbb465f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:47.898800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-52ad6e6e-cc0c-4cd6-a5c9-34edddbb465f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:47.915317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:47.924075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.235293 May 28 14:22:47.924646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 96/191] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:47 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:48.016897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-52ad6e6e-cc0c-4cd6-a5c9-34edddbb465f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 20991 microversion: 2.20 time: 0.136150 May 28 14:22:48.017547 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 96/192] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:47 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 20991 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:22:48.385092 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-49cb981c-2f58-47f7-adf0-066394fe67f1 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:48.385709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-49cb981c-2f58-47f7-adf0-066394fe67f1 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:48.392880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49cb981c-2f58-47f7-adf0-066394fe67f1 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:48.393340 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49cb981c-2f58-47f7-adf0-066394fe67f1 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:48.394147 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49cb981c-2f58-47f7-adf0-066394fe67f1 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:48.394600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49cb981c-2f58-47f7-adf0-066394fe67f1 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:48.597758 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-49cb981c-2f58-47f7-adf0-066394fe67f1 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:48.604434 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-49cb981c-2f58-47f7-adf0-066394fe67f1 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.223095 May 28 14:22:48.604940 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 97/193] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:48 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:48.942570 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:48.943276 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:48.951751 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:48.952218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:48.953073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:48.953523 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:49.028318 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f8c3ee87-2a25-46bd-a09d-ec2a7a059cf9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:49.029260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f8c3ee87-2a25-46bd-a09d-ec2a7a059cf9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:49.037080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee87-2a25-46bd-a09d-ec2a7a059cf9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:49.037545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee87-2a25-46bd-a09d-ec2a7a059cf9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:49.038354 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee87-2a25-46bd-a09d-ec2a7a059cf9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:49.038792 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee87-2a25-46bd-a09d-ec2a7a059cf9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:49.162701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f8c3ee87-2a25-46bd-a09d-ec2a7a059cf9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 22540 microversion: 2.20 time: 0.137846 May 28 14:22:49.164643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 98/194] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:49 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 22540 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:22:49.184631 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:49.187581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.249600 May 28 14:22:49.188175 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 97/195] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:48 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:49.621834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:49.622539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:49.631051 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:49.631486 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:49.632299 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:49.632737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:49.836960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:49.847828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.229977 May 28 14:22:49.853670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 99/196] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:49 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:50.174452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-299fe094-a698-4fa6-8890-eb9bb9508299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:50.176355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-299fe094-a698-4fa6-8890-eb9bb9508299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:50.184482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-299fe094-a698-4fa6-8890-eb9bb9508299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:50.185054 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-299fe094-a698-4fa6-8890-eb9bb9508299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:50.186116 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-299fe094-a698-4fa6-8890-eb9bb9508299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:50.186755 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-299fe094-a698-4fa6-8890-eb9bb9508299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:50.204461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:50.205084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:50.212847 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:50.213572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:50.214474 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:50.215100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:50.320292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-299fe094-a698-4fa6-8890-eb9bb9508299 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 23228 microversion: 2.20 time: 0.149339 May 28 14:22:50.320883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 98/197] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:50 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 23228 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:22:50.573147 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:50.582942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.382023 May 28 14:22:50.592726 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 100/198] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:50 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:50.866115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f1144f41-0ccc-4aeb-908b-722438cab063 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:50.867038 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f1144f41-0ccc-4aeb-908b-722438cab063 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:50.875244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1144f41-0ccc-4aeb-908b-722438cab063 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:50.875832 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1144f41-0ccc-4aeb-908b-722438cab063 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:50.876703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1144f41-0ccc-4aeb-908b-722438cab063 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:50.877220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1144f41-0ccc-4aeb-908b-722438cab063 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:51.088205 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f1144f41-0ccc-4aeb-908b-722438cab063 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:51.099280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f1144f41-0ccc-4aeb-908b-722438cab063 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1552 microversion: 2.1 time: 0.237645 May 28 14:22:51.099949 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 99/199] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:50 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:51.153014 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-eb82ced2-d4d4-417c-ad5b-c426cae0c144 req-1b832eb3-dedf-41d6-ad8d-2385da0f3ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da8b01f-1c47-4118-bc09-bffde9f331b7", "name": "network-vif-deleted", "tag": "6bfc4f29-c29d-4098-8314-02d1e6aa02a9"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:51.154639 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:22:51.154639 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:22:51.163515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-eb82ced2-d4d4-417c-ad5b-c426cae0c144 req-1b832eb3-dedf-41d6-ad8d-2385da0f3ce1 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:51.164744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-eb82ced2-d4d4-417c-ad5b-c426cae0c144 req-1b832eb3-dedf-41d6-ad8d-2385da0f3ce1 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:51.181026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-eb82ced2-d4d4-417c-ad5b-c426cae0c144 req-1b832eb3-dedf-41d6-ad8d-2385da0f3ce1 service nova] Creating event network-vif-deleted:6bfc4f29-c29d-4098-8314-02d1e6aa02a9 for instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 on hv-cinder-79128 May 28 14:22:51.185843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-eb82ced2-d4d4-417c-ad5b-c426cae0c144 req-1b832eb3-dedf-41d6-ad8d-2385da0f3ce1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 May 28 14:22:51.186441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 101/200] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:22:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:22:51.338382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6daff32a-00b8-4f03-919d-eb63660b7c9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:51.340105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6daff32a-00b8-4f03-919d-eb63660b7c9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:51.348566 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6daff32a-00b8-4f03-919d-eb63660b7c9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:51.349245 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6daff32a-00b8-4f03-919d-eb63660b7c9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:51.350445 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6daff32a-00b8-4f03-919d-eb63660b7c9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:51.360977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6daff32a-00b8-4f03-919d-eb63660b7c9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:51.494290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6daff32a-00b8-4f03-919d-eb63660b7c9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 24365 microversion: 2.20 time: 0.160411 May 28 14:22:51.498146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 100/201] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:51 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 24365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:22:51.601176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b870abe0-3ea2-4848-be75-59b5e35647e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:51.601891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b870abe0-3ea2-4848-be75-59b5e35647e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:51.609356 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b870abe0-3ea2-4848-be75-59b5e35647e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:51.609761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b870abe0-3ea2-4848-be75-59b5e35647e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:51.610546 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b870abe0-3ea2-4848-be75-59b5e35647e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:51.610987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b870abe0-3ea2-4848-be75-59b5e35647e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:51.816108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b870abe0-3ea2-4848-be75-59b5e35647e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:51.825082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b870abe0-3ea2-4848-be75-59b5e35647e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.228561 May 28 14:22:51.825741 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 102/202] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:51 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:52.117251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-107e7315-e974-4746-b5ae-13a3fc1338e0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:52.117951 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-107e7315-e974-4746-b5ae-13a3fc1338e0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:52.125771 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-107e7315-e974-4746-b5ae-13a3fc1338e0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:52.126224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-107e7315-e974-4746-b5ae-13a3fc1338e0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:52.127025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-107e7315-e974-4746-b5ae-13a3fc1338e0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:52.127465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-107e7315-e974-4746-b5ae-13a3fc1338e0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:52.296903 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-107e7315-e974-4746-b5ae-13a3fc1338e0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:52.306212 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-107e7315-e974-4746-b5ae-13a3fc1338e0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1345 microversion: 2.1 time: 0.193396 May 28 14:22:52.306779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 101/203] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:52 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:52.506628 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f506bc25-4952-45e2-ba61-d5b42aa96d17 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:52.507889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f506bc25-4952-45e2-ba61-d5b42aa96d17 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:52.515719 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f506bc25-4952-45e2-ba61-d5b42aa96d17 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:52.516251 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f506bc25-4952-45e2-ba61-d5b42aa96d17 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:52.517093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f506bc25-4952-45e2-ba61-d5b42aa96d17 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:52.517542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f506bc25-4952-45e2-ba61-d5b42aa96d17 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:52.646205 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f506bc25-4952-45e2-ba61-d5b42aa96d17 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 25100 microversion: 2.20 time: 0.143702 May 28 14:22:52.647472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 103/204] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:52 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 25100 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:22:52.842057 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:52.842680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:52.850536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:52.851004 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:52.851822 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:52.852267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:53.056905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:53.063500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.225178 May 28 14:22:53.064428 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 102/205] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:52 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:53.322826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-86808b98-20c0-4a7c-88cb-d3993c55fe7a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:53.323529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-86808b98-20c0-4a7c-88cb-d3993c55fe7a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:53.331565 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-86808b98-20c0-4a7c-88cb-d3993c55fe7a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:53.332038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-86808b98-20c0-4a7c-88cb-d3993c55fe7a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:53.332818 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-86808b98-20c0-4a7c-88cb-d3993c55fe7a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:53.333259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-86808b98-20c0-4a7c-88cb-d3993c55fe7a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:53.626916 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-86808b98-20c0-4a7c-88cb-d3993c55fe7a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:53.636615 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-86808b98-20c0-4a7c-88cb-d3993c55fe7a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1345 microversion: 2.1 time: 0.317963 May 28 14:22:53.637190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 104/206] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:53 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1345 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:22:53.658371 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2bb264a1-9563-4559-9a68-024583d68c70 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:22:53.659299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2bb264a1-9563-4559-9a68-024583d68c70 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:53.667119 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2bb264a1-9563-4559-9a68-024583d68c70 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:53.667599 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2bb264a1-9563-4559-9a68-024583d68c70 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:53.668383 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2bb264a1-9563-4559-9a68-024583d68c70 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:53.668819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2bb264a1-9563-4559-9a68-024583d68c70 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:54.081580 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:54.082242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:54.089479 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:54.089946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:54.090738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:54.091189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:54.289755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:54.298148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.220322 May 28 14:22:54.298714 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 105/207] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:54 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:54.654293 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cbcd0085-1b9b-4198-89d4-76fde280a668 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:54.654920 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cbcd0085-1b9b-4198-89d4-76fde280a668 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:54.670262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cbcd0085-1b9b-4198-89d4-76fde280a668 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:54.670262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cbcd0085-1b9b-4198-89d4-76fde280a668 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:54.670262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cbcd0085-1b9b-4198-89d4-76fde280a668 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:54.670262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cbcd0085-1b9b-4198-89d4-76fde280a668 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:54.782300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cbcd0085-1b9b-4198-89d4-76fde280a668 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:54.791795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cbcd0085-1b9b-4198-89d4-76fde280a668 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1345 microversion: 2.1 time: 0.141731 May 28 14:22:54.792375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 106/208] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:54 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:55.320768 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:55.321471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:55.328947 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:55.329482 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:55.330244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:55.330695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:55.536216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:55.545585 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.228704 May 28 14:22:55.546170 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 107/209] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:55 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:55.808844 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:55.809470 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:55.817068 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:55.817534 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:55.818520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:55.818814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:55.932737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:55.941947 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1345 microversion: 2.1 time: 0.136511 May 28 14:22:55.942481 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 108/210] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:55 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:56.562099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6edb950b-6748-400f-8e36-6f329e1e74a8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:56.562877 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6edb950b-6748-400f-8e36-6f329e1e74a8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:56.571062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6edb950b-6748-400f-8e36-6f329e1e74a8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:56.571522 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6edb950b-6748-400f-8e36-6f329e1e74a8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:56.572507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6edb950b-6748-400f-8e36-6f329e1e74a8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:56.572981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6edb950b-6748-400f-8e36-6f329e1e74a8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:56.777895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6edb950b-6748-400f-8e36-6f329e1e74a8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:56.786865 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6edb950b-6748-400f-8e36-6f329e1e74a8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.228509 May 28 14:22:56.787443 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 109/211] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:56 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:56.958578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:56.959193 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:56.966439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:56.966919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:56.967764 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:56.968207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:57.081632 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:57.090313 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1345 microversion: 2.1 time: 0.136156 May 28 14:22:57.090961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 110/212] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:56 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:57.804404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-843af564-1aa0-40fe-a378-2f0719f262e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:57.805037 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-843af564-1aa0-40fe-a378-2f0719f262e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:57.815700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-843af564-1aa0-40fe-a378-2f0719f262e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:57.815700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-843af564-1aa0-40fe-a378-2f0719f262e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:57.815700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-843af564-1aa0-40fe-a378-2f0719f262e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:57.815700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-843af564-1aa0-40fe-a378-2f0719f262e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:58.013311 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-843af564-1aa0-40fe-a378-2f0719f262e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:58.021691 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-843af564-1aa0-40fe-a378-2f0719f262e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.221727 May 28 14:22:58.022274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 111/213] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:57 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:58.106983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0b998892-35d2-469c-b97d-dae234bce72c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:58.107643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0b998892-35d2-469c-b97d-dae234bce72c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:58.115801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0b998892-35d2-469c-b97d-dae234bce72c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:58.116256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0b998892-35d2-469c-b97d-dae234bce72c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:58.117032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0b998892-35d2-469c-b97d-dae234bce72c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:58.117475 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0b998892-35d2-469c-b97d-dae234bce72c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:58.234498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0b998892-35d2-469c-b97d-dae234bce72c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:58.243530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0b998892-35d2-469c-b97d-dae234bce72c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1345 microversion: 2.1 time: 0.140283 May 28 14:22:58.244126 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 112/214] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:58 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:59.039034 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dfa716eb-6482-48a8-999e-8754660686ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:59.039674 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-dfa716eb-6482-48a8-999e-8754660686ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:59.047309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfa716eb-6482-48a8-999e-8754660686ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:59.047749 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfa716eb-6482-48a8-999e-8754660686ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:59.048527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfa716eb-6482-48a8-999e-8754660686ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:59.048966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfa716eb-6482-48a8-999e-8754660686ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:59.308781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-dfa716eb-6482-48a8-999e-8754660686ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:59.317231 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-dfa716eb-6482-48a8-999e-8754660686ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.281805 May 28 14:22:59.317867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 113/215] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:59 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:22:59.322332 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-67815de1-892f-4aa2-812e-a00af5f6dc53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:22:59.322953 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-67815de1-892f-4aa2-812e-a00af5f6dc53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:22:59.330268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67815de1-892f-4aa2-812e-a00af5f6dc53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:59.331325 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67815de1-892f-4aa2-812e-a00af5f6dc53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:59.332225 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67815de1-892f-4aa2-812e-a00af5f6dc53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:59.332610 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67815de1-892f-4aa2-812e-a00af5f6dc53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:59.355111 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2bb264a1-9563-4559-9a68-024583d68c70 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 27857 microversion: 2.20 time: 5.700338 May 28 14:22:59.356264 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 103/216] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:22:53 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 27857 bytes in 5702 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:22:59.449596 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-67815de1-892f-4aa2-812e-a00af5f6dc53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:22:59.459400 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-67815de1-892f-4aa2-812e-a00af5f6dc53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1345 microversion: 2.1 time: 0.140504 May 28 14:22:59.460050 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 114/217] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:22:59 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:00.335312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:00.335979 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:00.343882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:00.344342 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:00.345134 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:00.345580 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:00.367813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-032ea403-a092-4fa0-b3a5-f87d6c7c0d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:00.368910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-032ea403-a092-4fa0-b3a5-f87d6c7c0d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:00.376563 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-032ea403-a092-4fa0-b3a5-f87d6c7c0d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:00.377010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-032ea403-a092-4fa0-b3a5-f87d6c7c0d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:00.378343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-032ea403-a092-4fa0-b3a5-f87d6c7c0d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:00.378790 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-032ea403-a092-4fa0-b3a5-f87d6c7c0d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:00.484555 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-032ea403-a092-4fa0-b3a5-f87d6c7c0d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 27859 microversion: 2.20 time: 0.120778 May 28 14:23:00.485459 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 115/218] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:00 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 27859 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:23:00.490954 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5843e9a7-509c-4a96-9cab-7bb19acd1823 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:00.491677 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5843e9a7-509c-4a96-9cab-7bb19acd1823 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:00.499657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5843e9a7-509c-4a96-9cab-7bb19acd1823 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:00.500120 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5843e9a7-509c-4a96-9cab-7bb19acd1823 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:00.500946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5843e9a7-509c-4a96-9cab-7bb19acd1823 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:00.501393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5843e9a7-509c-4a96-9cab-7bb19acd1823 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:00.551373 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:00.560577 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.229873 May 28 14:23:00.561164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 104/219] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:00 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:00.616076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5843e9a7-509c-4a96-9cab-7bb19acd1823 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:00.624852 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5843e9a7-509c-4a96-9cab-7bb19acd1823 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1345 microversion: 2.1 time: 0.138428 May 28 14:23:00.625423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 116/220] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:00 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:01.496753 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b7bff1a0-8718-45f9-a9e9-cc298b65c02f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:01.497791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b7bff1a0-8718-45f9-a9e9-cc298b65c02f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:01.505878 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b7bff1a0-8718-45f9-a9e9-cc298b65c02f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:01.506330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b7bff1a0-8718-45f9-a9e9-cc298b65c02f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:01.507169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b7bff1a0-8718-45f9-a9e9-cc298b65c02f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:01.507625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b7bff1a0-8718-45f9-a9e9-cc298b65c02f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:01.578716 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bd70237c-b9cb-4841-994c-2c5c58ce4719 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:01.579328 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bd70237c-b9cb-4841-994c-2c5c58ce4719 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:01.587946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bd70237c-b9cb-4841-994c-2c5c58ce4719 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:01.588410 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bd70237c-b9cb-4841-994c-2c5c58ce4719 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:01.589218 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bd70237c-b9cb-4841-994c-2c5c58ce4719 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:01.589696 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bd70237c-b9cb-4841-994c-2c5c58ce4719 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:01.615517 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b7bff1a0-8718-45f9-a9e9-cc298b65c02f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 27859 microversion: 2.20 time: 0.122072 May 28 14:23:01.619627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 105/221] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:01 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 27859 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:01.642457 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:01.644106 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:01.652258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:01.656123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:01.656123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:01.656123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:01.723127 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:01.723609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:01.724090 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lazy-loading 'fault' on Instance uuid 2da8b01f-1c47-4118-bc09-bffde9f331b7 {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:23:01.782820 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeb8c620af4a1398f7505cde5a58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ce685b86cb47abba407b2e49dcf373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:01.790805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-74550e30-6945-432b-920c-f0daac9d685d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 200 len: 1304 microversion: 2.1 time: 0.152514 May 28 14:23:01.791484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 106/222] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:01 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:01.794790 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bd70237c-b9cb-4841-994c-2c5c58ce4719 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:01.803391 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bd70237c-b9cb-4841-994c-2c5c58ce4719 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.228401 May 28 14:23:01.804375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 117/223] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:01 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:02.626727 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a87dfc3f-e8c1-47b1-9569-1ec7b9378bba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:02.628203 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a87dfc3f-e8c1-47b1-9569-1ec7b9378bba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:02.635804 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a87dfc3f-e8c1-47b1-9569-1ec7b9378bba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:02.636272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a87dfc3f-e8c1-47b1-9569-1ec7b9378bba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:02.637072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a87dfc3f-e8c1-47b1-9569-1ec7b9378bba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:02.637520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a87dfc3f-e8c1-47b1-9569-1ec7b9378bba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:02.775693 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a87dfc3f-e8c1-47b1-9569-1ec7b9378bba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 27986 microversion: 2.20 time: 0.152398 May 28 14:23:02.776262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 107/224] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:02 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 27986 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:23:02.810192 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:02.810818 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:02.819699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:02.819699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:02.821797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:02.821797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:02.824930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bd63bf28-dd63-4191-89ab-eb82b1553c66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:02.825774 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bd63bf28-dd63-4191-89ab-eb82b1553c66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:02.834738 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bd63bf28-dd63-4191-89ab-eb82b1553c66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:02.835310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bd63bf28-dd63-4191-89ab-eb82b1553c66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:02.836353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bd63bf28-dd63-4191-89ab-eb82b1553c66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:02.836869 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bd63bf28-dd63-4191-89ab-eb82b1553c66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:02.880463 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] HTTP exception thrown: Instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 could not be found. May 28 14:23:02.881128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Returning 404 to user: Instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:02.882031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4dade5ec-3390-43f0-aeec-3b798ad8c85c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 404 len: 111 microversion: 2.1 time: 0.075760 May 28 14:23:02.882635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 118/225] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:02 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:23:03.050744 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bd63bf28-dd63-4191-89ab-eb82b1553c66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:03.059869 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bd63bf28-dd63-4191-89ab-eb82b1553c66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1521 microversion: 2.1 time: 0.242661 May 28 14:23:03.060546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 108/226] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:02 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:03.788176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-abd801b4-ce64-4e8a-bbbb-8004231a195f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:03.789115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-abd801b4-ce64-4e8a-bbbb-8004231a195f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:03.796787 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abd801b4-ce64-4e8a-bbbb-8004231a195f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:03.797249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abd801b4-ce64-4e8a-bbbb-8004231a195f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:03.798038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abd801b4-ce64-4e8a-bbbb-8004231a195f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:03.798489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abd801b4-ce64-4e8a-bbbb-8004231a195f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:04.077109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:04.077806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:04.085894 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:04.086444 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:04.087310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:04.087860 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:04.282258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:04.291776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1501 microversion: 2.1 time: 0.218480 May 28 14:23:04.292527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 109/227] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:04 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1501 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:04.309091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f4f6928b-3528-4ff1-aded-5924e1222011 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:04.309783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f4f6928b-3528-4ff1-aded-5924e1222011 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:04.320428 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4f6928b-3528-4ff1-aded-5924e1222011 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:04.321137 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4f6928b-3528-4ff1-aded-5924e1222011 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:04.322341 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4f6928b-3528-4ff1-aded-5924e1222011 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:04.322855 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4f6928b-3528-4ff1-aded-5924e1222011 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:04.546480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f4f6928b-3528-4ff1-aded-5924e1222011 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:04.555349 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f4f6928b-3528-4ff1-aded-5924e1222011 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1515 microversion: 2.1 time: 0.250185 May 28 14:23:04.556521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 110/228] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:04 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:09.041971 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-abd801b4-ce64-4e8a-bbbb-8004231a195f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28103 microversion: 2.20 time: 5.257997 May 28 14:23:09.045824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 119/229] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:03 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28103 bytes in 5260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:10.054216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7cf29f3b-d9bb-4642-b5aa-a6b2bcb227f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:10.055164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7cf29f3b-d9bb-4642-b5aa-a6b2bcb227f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:10.062999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7cf29f3b-d9bb-4642-b5aa-a6b2bcb227f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:10.063455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7cf29f3b-d9bb-4642-b5aa-a6b2bcb227f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:10.064267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7cf29f3b-d9bb-4642-b5aa-a6b2bcb227f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:10.064702 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7cf29f3b-d9bb-4642-b5aa-a6b2bcb227f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:10.181987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7cf29f3b-d9bb-4642-b5aa-a6b2bcb227f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28103 microversion: 2.20 time: 0.131227 May 28 14:23:10.182644 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 111/230] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:10 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28103 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:23:11.194811 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-76124bdd-3707-4c58-9dd0-51537879e9c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:11.196024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-76124bdd-3707-4c58-9dd0-51537879e9c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:11.204817 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-76124bdd-3707-4c58-9dd0-51537879e9c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:11.205084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-76124bdd-3707-4c58-9dd0-51537879e9c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:11.206496 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-76124bdd-3707-4c58-9dd0-51537879e9c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:11.207050 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-76124bdd-3707-4c58-9dd0-51537879e9c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:15.905647 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-76124bdd-3707-4c58-9dd0-51537879e9c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 4.714808 May 28 14:23:15.906659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 120/231] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:11 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 4717 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:16.918361 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2f76b10b-c2f4-42c8-8c86-fde2cde35f97 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:16.919359 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2f76b10b-c2f4-42c8-8c86-fde2cde35f97 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:16.927715 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f76b10b-c2f4-42c8-8c86-fde2cde35f97 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:16.928169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f76b10b-c2f4-42c8-8c86-fde2cde35f97 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:16.929270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f76b10b-c2f4-42c8-8c86-fde2cde35f97 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:16.929713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f76b10b-c2f4-42c8-8c86-fde2cde35f97 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:17.032354 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2f76b10b-c2f4-42c8-8c86-fde2cde35f97 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.118054 May 28 14:23:17.033119 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 112/232] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:16 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:18.045802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-16f447c9-3ab0-4052-8963-e31e4859f390 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:18.051386 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-16f447c9-3ab0-4052-8963-e31e4859f390 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:18.057180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16f447c9-3ab0-4052-8963-e31e4859f390 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:18.057641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16f447c9-3ab0-4052-8963-e31e4859f390 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:18.058455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16f447c9-3ab0-4052-8963-e31e4859f390 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:18.058952 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16f447c9-3ab0-4052-8963-e31e4859f390 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:18.174420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-16f447c9-3ab0-4052-8963-e31e4859f390 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.132538 May 28 14:23:18.175243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 121/233] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:18 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:19.187271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a90bb7ed-2163-4fd7-9d7a-1fc315ada9d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:19.188425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a90bb7ed-2163-4fd7-9d7a-1fc315ada9d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:19.197224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a90bb7ed-2163-4fd7-9d7a-1fc315ada9d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:19.197680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a90bb7ed-2163-4fd7-9d7a-1fc315ada9d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:19.198710 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a90bb7ed-2163-4fd7-9d7a-1fc315ada9d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:19.199157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a90bb7ed-2163-4fd7-9d7a-1fc315ada9d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:19.326726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a90bb7ed-2163-4fd7-9d7a-1fc315ada9d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.143909 May 28 14:23:19.328251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 113/234] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:19 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:19.899607 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:19.901630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:19.911417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:19.912302 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:19.913137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:19.913592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:19.972382 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lazy-loading 'flavor' on Instance uuid 9c17d712-c03d-44ac-bd8d-5f9b99160b0f {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:23:20.339076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8155ea6c-89e9-4f31-aaf5-35e270dd4d56 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:20.340501 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8155ea6c-89e9-4f31-aaf5-35e270dd4d56 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:20.350159 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8155ea6c-89e9-4f31-aaf5-35e270dd4d56 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:20.350720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8155ea6c-89e9-4f31-aaf5-35e270dd4d56 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:20.351766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8155ea6c-89e9-4f31-aaf5-35e270dd4d56 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:20.352282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8155ea6c-89e9-4f31-aaf5-35e270dd4d56 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:20.465309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action" status: 200 len: 32 microversion: 2.1 time: 0.570065 May 28 14:23:20.468034 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8155ea6c-89e9-4f31-aaf5-35e270dd4d56 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.132968 May 28 14:23:20.469338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 114/235] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:20 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:23:20.470832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 122/236] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:23:19 2021] POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action => generated 32 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:23:20.477791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:20.478767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:20.487405 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:20.488015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:20.488946 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:20.489561 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:20.690915 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:20.700581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.227865 May 28 14:23:20.701979 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 115/237] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:20 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:21.467724 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:21.467724 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:21.474090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:21.474540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:21.475325 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:21.475794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:21.481022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b033823a-c9d3-4e83-ba56-34caf759c8ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:21.482112 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b033823a-c9d3-4e83-ba56-34caf759c8ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:21.512925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b033823a-c9d3-4e83-ba56-34caf759c8ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:21.513533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b033823a-c9d3-4e83-ba56-34caf759c8ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:21.514452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b033823a-c9d3-4e83-ba56-34caf759c8ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:21.515015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b033823a-c9d3-4e83-ba56-34caf759c8ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:21.531093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] HTTP exception thrown: Instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 could not be found. May 28 14:23:21.531738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Returning 404 to user: Instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:21.532578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3b152421-5e5f-40cb-b71d-b4a9e8cce239 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 404 len: 111 microversion: 2.1 time: 0.071420 May 28 14:23:21.533513 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 123/238] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:23:21 2021] DELETE /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:23:21.541168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:21.541780 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] [instance: 2da8b01f-1c47-4118-bc09-bffde9f331b7] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:21.550657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:21.551436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:21.552717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:21.553295 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:21.611181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] HTTP exception thrown: Instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 could not be found. May 28 14:23:21.612484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Returning 404 to user: Instance 2da8b01f-1c47-4118-bc09-bffde9f331b7 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:21.613299 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4d796526-4a4f-4d25-bf57-f219676ace6b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7" status: 404 len: 111 microversion: 2.1 time: 0.076043 May 28 14:23:21.613887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 124/239] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:21 2021] GET /compute/v2.1/servers/2da8b01f-1c47-4118-bc09-bffde9f331b7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:23:21.718612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-402d47b4-a99e-455c-891e-d0b970eb8f6e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:21.730700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-402d47b4-a99e-455c-891e-d0b970eb8f6e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:21.756887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-402d47b4-a99e-455c-891e-d0b970eb8f6e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:21.757744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-402d47b4-a99e-455c-891e-d0b970eb8f6e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:21.758888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-402d47b4-a99e-455c-891e-d0b970eb8f6e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:21.759415 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-402d47b4-a99e-455c-891e-d0b970eb8f6e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:22.149920 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-402d47b4-a99e-455c-891e-d0b970eb8f6e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:22.156511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-402d47b4-a99e-455c-891e-d0b970eb8f6e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.441725 May 28 14:23:22.159449 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 125/240] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:21 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:23.179904 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b6e7fc59-834a-4108-bf0b-a849ff75d471 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:23.179904 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b6e7fc59-834a-4108-bf0b-a849ff75d471 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:23.186945 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6e7fc59-834a-4108-bf0b-a849ff75d471 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:23.187413 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6e7fc59-834a-4108-bf0b-a849ff75d471 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:23.188238 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6e7fc59-834a-4108-bf0b-a849ff75d471 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:23.188683 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6e7fc59-834a-4108-bf0b-a849ff75d471 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:23.408630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b6e7fc59-834a-4108-bf0b-a849ff75d471 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:23.415102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b6e7fc59-834a-4108-bf0b-a849ff75d471 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.244096 May 28 14:23:23.415753 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 126/241] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:23 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:24.432538 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-251752ab-bfee-481a-9a0e-7b44892db825 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:24.433184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-251752ab-bfee-481a-9a0e-7b44892db825 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:24.441798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-251752ab-bfee-481a-9a0e-7b44892db825 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:24.442472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-251752ab-bfee-481a-9a0e-7b44892db825 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:24.443495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-251752ab-bfee-481a-9a0e-7b44892db825 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:24.444229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-251752ab-bfee-481a-9a0e-7b44892db825 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:24.646239 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-251752ab-bfee-481a-9a0e-7b44892db825 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:24.654666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-251752ab-bfee-481a-9a0e-7b44892db825 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.225910 May 28 14:23:24.655267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 127/242] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:24 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:25.418852 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-23e732ef-1e7c-4f5a-bb1e-78931aed7a10 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Action: 'create', calling method: .version_select at 0x7f2aae5679d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-436870614", "metadata": {"Type": "work"}}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:25.420571 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-23e732ef-1e7c-4f5a-bb1e-78931aed7a10 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:25.421459 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-23e732ef-1e7c-4f5a-bb1e-78931aed7a10 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131994 May 28 14:23:25.422167 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 128/243] 10.222.0.59 () {60 vars in 1156 bytes} [Fri May 28 14:23:25 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 14:23:25.431456 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c921009a-bcf9-4249-aaa3-16ac7d912cfd tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Action: 'create', calling method: .version_select at 0x7f2aadab0940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-123953380", "metadata": {"Type": "work"}}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:25.432686 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c921009a-bcf9-4249-aaa3-16ac7d912cfd tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:25.433487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c921009a-bcf9-4249-aaa3-16ac7d912cfd tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005631 May 28 14:23:25.434009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 129/244] 10.222.0.59 () {60 vars in 1156 bytes} [Fri May 28 14:23:25 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 14:23:25.444509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-faca3a57-3e14-427b-aef3-bb181059fae6 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Action: 'create', calling method: .version_select at 0x7f2aad9f8f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-77555389", "metadata": {"Type": "work"}}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:25.445657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-faca3a57-3e14-427b-aef3-bb181059fae6 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:25.446714 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-faca3a57-3e14-427b-aef3-bb181059fae6 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007048 May 28 14:23:25.447234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 130/245] 10.222.0.59 () {60 vars in 1156 bytes} [Fri May 28 14:23:25 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 14:23:25.456294 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5ece7360-c695-44f9-9168-602ef593af7a tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Calling method '.version_select at 0x7f2aada0f4c0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:25.518256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-5ece7360-c695-44f9-9168-602ef593af7a tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] HTTP exception thrown: Volume tempest-invalid-188203830 could not be found. May 28 14:23:25.518256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5ece7360-c695-44f9-9168-602ef593af7a tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Returning 404 to user: Volume tempest-invalid-188203830 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:25.518256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5ece7360-c695-44f9-9168-602ef593af7a tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-188203830" status: 404 len: 98 microversion: 2.1 time: 0.064725 May 28 14:23:25.518544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 131/246] 10.222.0.59 () {58 vars in 1215 bytes} [Fri May 28 14:23:25 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-188203830 => generated 98 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 14:23:25.527416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-94c64b22-173e-45ac-ae12-b3e49f7e8da4 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004226 May 28 14:23:25.527958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 132/247] 10.222.0.59 () {58 vars in 1140 bytes} [Fri May 28 14:23:25 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 28 14:23:25.538213 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-88337001-5273-4e6c-b303-abf1f3b0ecb8 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005583 May 28 14:23:25.539005 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 133/248] 10.222.0.59 () {58 vars in 1137 bytes} [Fri May 28 14:23:25 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 28 14:23:25.547208 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5a9cf6f6-7121-47e5-8b77-dd439a0989a6 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Calling method '.version_select at 0x7f2aada0f700>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:25.606399 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-5a9cf6f6-7121-47e5-8b77-dd439a0989a6 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] HTTP exception thrown: Volume cfd4e479-a728-4436-979e-13345aa9b391 could not be found. May 28 14:23:25.607009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5a9cf6f6-7121-47e5-8b77-dd439a0989a6 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Returning 404 to user: Volume cfd4e479-a728-4436-979e-13345aa9b391 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:25.607905 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5a9cf6f6-7121-47e5-8b77-dd439a0989a6 tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/cfd4e479-a728-4436-979e-13345aa9b391" status: 404 len: 109 microversion: 2.1 time: 0.064011 May 28 14:23:25.608478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 134/249] 10.222.0.59 () {58 vars in 1248 bytes} [Fri May 28 14:23:25 2021] DELETE /compute/v2.1/os-volumes/cfd4e479-a728-4436-979e-13345aa9b391 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:23:25.617879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d0c94023-23c1-4f1e-aee3-38ba447e4eaa tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Calling method '.version_select at 0x7f2aaf72e9d0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:25.677777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-d0c94023-23c1-4f1e-aee3-38ba447e4eaa tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] HTTP exception thrown: Volume 8cdde292-69d6-455c-a8b1-1bfda537df50 could not be found. May 28 14:23:25.678450 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d0c94023-23c1-4f1e-aee3-38ba447e4eaa tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] Returning 404 to user: Volume 8cdde292-69d6-455c-a8b1-1bfda537df50 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:25.683068 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d0c94023-23c1-4f1e-aee3-38ba447e4eaa tempest-VolumesNegativeTest-1731231943 tempest-VolumesNegativeTest-1731231943-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8cdde292-69d6-455c-a8b1-1bfda537df50" status: 404 len: 109 microversion: 2.1 time: 0.065109 May 28 14:23:25.683068 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 135/250] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:23:25 2021] GET /compute/v2.1/os-volumes/8cdde292-69d6-455c-a8b1-1bfda537df50 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:23:25.684505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b173d0aa-f90a-49ff-8014-3ed9a3033046 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:25.685273 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b173d0aa-f90a-49ff-8014-3ed9a3033046 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:25.693415 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b173d0aa-f90a-49ff-8014-3ed9a3033046 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:25.693877 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b173d0aa-f90a-49ff-8014-3ed9a3033046 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:25.694678 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b173d0aa-f90a-49ff-8014-3ed9a3033046 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:25.695116 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b173d0aa-f90a-49ff-8014-3ed9a3033046 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:25.907289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b173d0aa-f90a-49ff-8014-3ed9a3033046 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:25.916098 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b173d0aa-f90a-49ff-8014-3ed9a3033046 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.235167 May 28 14:23:25.916678 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 136/251] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:25 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:26.521750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b033823a-c9d3-4e83-ba56-34caf759c8ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 5.044978 May 28 14:23:26.522993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 116/252] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:21 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 5047 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:26.933062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:26.941409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:26.943467 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:26.943978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:26.945022 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:26.945479 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:27.464288 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:27.474756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.545399 May 28 14:23:27.485652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 137/253] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:26 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:27.535382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ad0c009d-57c7-4c5b-ac94-9ba05d99dfee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:27.540595 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ad0c009d-57c7-4c5b-ac94-9ba05d99dfee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:27.544650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ad0c009d-57c7-4c5b-ac94-9ba05d99dfee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:27.545103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ad0c009d-57c7-4c5b-ac94-9ba05d99dfee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:27.545887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ad0c009d-57c7-4c5b-ac94-9ba05d99dfee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:27.546388 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ad0c009d-57c7-4c5b-ac94-9ba05d99dfee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:27.741477 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ad0c009d-57c7-4c5b-ac94-9ba05d99dfee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.211059 May 28 14:23:27.742385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 117/254] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:27 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:28.493573 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4ac57f22-a979-4ef8-9ade-1d223142159f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:28.494259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4ac57f22-a979-4ef8-9ade-1d223142159f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:28.503082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4ac57f22-a979-4ef8-9ade-1d223142159f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:28.503548 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4ac57f22-a979-4ef8-9ade-1d223142159f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:28.504373 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4ac57f22-a979-4ef8-9ade-1d223142159f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:28.504824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4ac57f22-a979-4ef8-9ade-1d223142159f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:28.720934 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4ac57f22-a979-4ef8-9ade-1d223142159f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:28.730179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4ac57f22-a979-4ef8-9ade-1d223142159f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.240479 May 28 14:23:28.730760 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 138/255] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:28 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:28.754531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bdd1b31a-dd1b-4909-ba4a-5b3fe2183f47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:28.755650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bdd1b31a-dd1b-4909-ba4a-5b3fe2183f47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:28.763779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdd1b31a-dd1b-4909-ba4a-5b3fe2183f47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:28.764298 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdd1b31a-dd1b-4909-ba4a-5b3fe2183f47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:28.765086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdd1b31a-dd1b-4909-ba4a-5b3fe2183f47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:28.768463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdd1b31a-dd1b-4909-ba4a-5b3fe2183f47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:28.906092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bdd1b31a-dd1b-4909-ba4a-5b3fe2183f47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.156150 May 28 14:23:28.906817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 118/256] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:28 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:29.749507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:29.750124 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:29.757394 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:29.757949 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:29.758737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:29.762958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:29.922829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f211bf01-07d7-4282-a69c-bca57d88f1c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:29.924575 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f211bf01-07d7-4282-a69c-bca57d88f1c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:29.943633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f211bf01-07d7-4282-a69c-bca57d88f1c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:29.944099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f211bf01-07d7-4282-a69c-bca57d88f1c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:29.945452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f211bf01-07d7-4282-a69c-bca57d88f1c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:29.945889 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f211bf01-07d7-4282-a69c-bca57d88f1c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:30.001182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:30.010883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.265006 May 28 14:23:30.011464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 139/257] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:29 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:30.075322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f211bf01-07d7-4282-a69c-bca57d88f1c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.157023 May 28 14:23:30.076225 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 119/258] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:29 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:23:31.029100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-de54a2a4-9d89-4978-ac59-3e3da2040a36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:31.029790 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-de54a2a4-9d89-4978-ac59-3e3da2040a36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:31.039301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de54a2a4-9d89-4978-ac59-3e3da2040a36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:31.039795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de54a2a4-9d89-4978-ac59-3e3da2040a36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:31.040808 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de54a2a4-9d89-4978-ac59-3e3da2040a36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:31.041249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de54a2a4-9d89-4978-ac59-3e3da2040a36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:31.087594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d95c1f3f-fd62-4aab-b6e4-a1a9dce25c3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:31.088675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d95c1f3f-fd62-4aab-b6e4-a1a9dce25c3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:31.098224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d95c1f3f-fd62-4aab-b6e4-a1a9dce25c3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:31.099285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d95c1f3f-fd62-4aab-b6e4-a1a9dce25c3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:31.099804 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d95c1f3f-fd62-4aab-b6e4-a1a9dce25c3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:31.100294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d95c1f3f-fd62-4aab-b6e4-a1a9dce25c3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:31.235431 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d95c1f3f-fd62-4aab-b6e4-a1a9dce25c3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.152554 May 28 14:23:31.237535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 120/259] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:31 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:23:31.363082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-de54a2a4-9d89-4978-ac59-3e3da2040a36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:31.383082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-de54a2a4-9d89-4978-ac59-3e3da2040a36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.356201 May 28 14:23:31.384114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 140/260] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:31 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:32.249869 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a5a839e3-aa56-46b7-9598-46b5694d982b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:32.250994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a5a839e3-aa56-46b7-9598-46b5694d982b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:32.260808 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5a839e3-aa56-46b7-9598-46b5694d982b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:32.263705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5a839e3-aa56-46b7-9598-46b5694d982b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:32.263705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5a839e3-aa56-46b7-9598-46b5694d982b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:32.263705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5a839e3-aa56-46b7-9598-46b5694d982b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:32.401837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-110ac468-4928-44bb-a903-0a5e206df72e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:32.408355 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-110ac468-4928-44bb-a903-0a5e206df72e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:32.417635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-110ac468-4928-44bb-a903-0a5e206df72e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:32.418529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-110ac468-4928-44bb-a903-0a5e206df72e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:32.419854 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-110ac468-4928-44bb-a903-0a5e206df72e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:32.420527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-110ac468-4928-44bb-a903-0a5e206df72e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:32.452777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a5a839e3-aa56-46b7-9598-46b5694d982b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.207137 May 28 14:23:32.453450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 121/261] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:32 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:32.718623 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-110ac468-4928-44bb-a903-0a5e206df72e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:32.718623 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-110ac468-4928-44bb-a903-0a5e206df72e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.320699 May 28 14:23:32.718623 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 141/262] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:32 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:33.465287 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-07b7a486-dba5-42c7-a56d-ebcd3117ade6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:33.466385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-07b7a486-dba5-42c7-a56d-ebcd3117ade6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:33.475945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-07b7a486-dba5-42c7-a56d-ebcd3117ade6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:33.476402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-07b7a486-dba5-42c7-a56d-ebcd3117ade6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:33.477194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-07b7a486-dba5-42c7-a56d-ebcd3117ade6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:33.477634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-07b7a486-dba5-42c7-a56d-ebcd3117ade6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:33.620847 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-07b7a486-dba5-42c7-a56d-ebcd3117ade6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.159463 May 28 14:23:33.621539 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 122/263] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:33 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:33.736746 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:33.737893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:33.747401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:33.748300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:33.749349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:33.750111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:34.209720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:34.218951 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.488591 May 28 14:23:34.219539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 142/264] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:33 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:34.633554 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1c61343f-1fe2-4e9d-a87b-af2954756b5b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:34.635404 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1c61343f-1fe2-4e9d-a87b-af2954756b5b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:34.644655 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c61343f-1fe2-4e9d-a87b-af2954756b5b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:34.645343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c61343f-1fe2-4e9d-a87b-af2954756b5b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:34.646387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c61343f-1fe2-4e9d-a87b-af2954756b5b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:34.647054 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c61343f-1fe2-4e9d-a87b-af2954756b5b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:34.799218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1c61343f-1fe2-4e9d-a87b-af2954756b5b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.169127 May 28 14:23:34.800616 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 123/265] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:34 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:35.237686 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-852ff1dd-7dae-4182-8e70-86bd354927a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:35.238306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-852ff1dd-7dae-4182-8e70-86bd354927a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:35.245932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-852ff1dd-7dae-4182-8e70-86bd354927a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:35.246394 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-852ff1dd-7dae-4182-8e70-86bd354927a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:35.247182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-852ff1dd-7dae-4182-8e70-86bd354927a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:35.247659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-852ff1dd-7dae-4182-8e70-86bd354927a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:35.478440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-852ff1dd-7dae-4182-8e70-86bd354927a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:35.489104 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-852ff1dd-7dae-4182-8e70-86bd354927a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.255580 May 28 14:23:35.501982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 143/266] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:35 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:35.858716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-71e2a93d-e634-445c-9137-b5020dd0b278 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:35.858716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-71e2a93d-e634-445c-9137-b5020dd0b278 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:35.858716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-71e2a93d-e634-445c-9137-b5020dd0b278 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:35.858716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-71e2a93d-e634-445c-9137-b5020dd0b278 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:35.859494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-71e2a93d-e634-445c-9137-b5020dd0b278 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:35.859494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-71e2a93d-e634-445c-9137-b5020dd0b278 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:35.938901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-71e2a93d-e634-445c-9137-b5020dd0b278 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.131710 May 28 14:23:35.939763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 124/267] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:35 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:36.511778 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:36.513812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:36.525744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:36.526396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:36.527199 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:36.527692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:36.774689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:36.784172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.279708 May 28 14:23:36.794372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 144/268] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:36 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:36.950901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-67a95e8a-5fc7-4347-b54e-3705f141c277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:36.951919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-67a95e8a-5fc7-4347-b54e-3705f141c277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:36.962573 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-67a95e8a-5fc7-4347-b54e-3705f141c277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:36.962967 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-67a95e8a-5fc7-4347-b54e-3705f141c277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:36.963823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-67a95e8a-5fc7-4347-b54e-3705f141c277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:36.964263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-67a95e8a-5fc7-4347-b54e-3705f141c277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:37.801613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:37.802231 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:37.809992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:37.810206 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:37.810918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:37.811368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:38.147898 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:38.156344 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.358660 May 28 14:23:38.156917 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 145/269] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:37 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:39.174891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9206cfaa-483c-4eb3-bd81-1da015f7adef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:39.175646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9206cfaa-483c-4eb3-bd81-1da015f7adef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:39.183251 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9206cfaa-483c-4eb3-bd81-1da015f7adef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:39.183866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9206cfaa-483c-4eb3-bd81-1da015f7adef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:39.184784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9206cfaa-483c-4eb3-bd81-1da015f7adef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:39.185264 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9206cfaa-483c-4eb3-bd81-1da015f7adef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:39.401179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9206cfaa-483c-4eb3-bd81-1da015f7adef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:39.410648 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9206cfaa-483c-4eb3-bd81-1da015f7adef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.240363 May 28 14:23:39.411229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 146/270] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:39 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:40.428012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:40.428652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:40.435930 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:40.436398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:40.437191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:40.437640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:40.656267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:40.665483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.241812 May 28 14:23:40.666049 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 147/271] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:40 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:41.681924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-717cad4f-da3f-49cc-99c6-3c1041f879a4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:41.682631 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-717cad4f-da3f-49cc-99c6-3c1041f879a4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:41.690230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-717cad4f-da3f-49cc-99c6-3c1041f879a4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:41.690684 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-717cad4f-da3f-49cc-99c6-3c1041f879a4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:41.691459 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-717cad4f-da3f-49cc-99c6-3c1041f879a4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:41.691924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-717cad4f-da3f-49cc-99c6-3c1041f879a4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:41.887497 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-717cad4f-da3f-49cc-99c6-3c1041f879a4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:41.896169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-717cad4f-da3f-49cc-99c6-3c1041f879a4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.217861 May 28 14:23:41.896785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 148/272] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:41 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:42.424967 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-67a95e8a-5fc7-4347-b54e-3705f141c277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 5.477977 May 28 14:23:42.425675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 125/273] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:36 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 5480 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:42.913917 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-46029d22-ad97-41a1-a513-f4d24015ed32 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:42.914769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-46029d22-ad97-41a1-a513-f4d24015ed32 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:42.922376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-46029d22-ad97-41a1-a513-f4d24015ed32 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:42.922989 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-46029d22-ad97-41a1-a513-f4d24015ed32 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:42.923924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-46029d22-ad97-41a1-a513-f4d24015ed32 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:42.924473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-46029d22-ad97-41a1-a513-f4d24015ed32 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:43.125061 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-46029d22-ad97-41a1-a513-f4d24015ed32 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:43.133627 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-46029d22-ad97-41a1-a513-f4d24015ed32 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.223407 May 28 14:23:43.134255 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 149/274] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:42 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:43.437487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3dd4a7b6-5ef3-486f-be22-504b7fab25e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:43.442449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3dd4a7b6-5ef3-486f-be22-504b7fab25e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:43.451211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3dd4a7b6-5ef3-486f-be22-504b7fab25e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:43.451731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3dd4a7b6-5ef3-486f-be22-504b7fab25e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:43.452544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3dd4a7b6-5ef3-486f-be22-504b7fab25e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:43.452993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3dd4a7b6-5ef3-486f-be22-504b7fab25e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:43.563118 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3dd4a7b6-5ef3-486f-be22-504b7fab25e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.129602 May 28 14:23:43.563840 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 126/275] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:43 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:44.152353 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:44.154699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:44.166998 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:44.167479 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:44.168349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:44.168906 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:44.402832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:44.412051 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.265471 May 28 14:23:44.412825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 150/276] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:44 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:44.581127 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0067d773-a085-46e5-a3ec-56524eadf61e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:44.582714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0067d773-a085-46e5-a3ec-56524eadf61e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:44.591344 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0067d773-a085-46e5-a3ec-56524eadf61e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:44.591945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0067d773-a085-46e5-a3ec-56524eadf61e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:44.592836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0067d773-a085-46e5-a3ec-56524eadf61e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:44.593355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0067d773-a085-46e5-a3ec-56524eadf61e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:44.753877 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0067d773-a085-46e5-a3ec-56524eadf61e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.177824 May 28 14:23:44.757770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 127/277] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:44 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:45.431139 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:45.431910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:45.440288 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:45.441024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:45.442065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:45.442701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:45.646928 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:45.655184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.228346 May 28 14:23:45.655784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 151/278] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:45 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:45.766365 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6d5b11d9-8fa0-4d2f-8e50-8056528590fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:45.768963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6d5b11d9-8fa0-4d2f-8e50-8056528590fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:45.777787 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6d5b11d9-8fa0-4d2f-8e50-8056528590fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:45.778286 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6d5b11d9-8fa0-4d2f-8e50-8056528590fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:45.779095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6d5b11d9-8fa0-4d2f-8e50-8056528590fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:45.779606 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6d5b11d9-8fa0-4d2f-8e50-8056528590fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:45.969227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6d5b11d9-8fa0-4d2f-8e50-8056528590fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.207048 May 28 14:23:45.969968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 128/279] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:45 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:46.673168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:46.673830 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:46.689580 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:46.690560 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:46.691884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:46.692499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:46.988255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d3b4eb29-3dd1-4891-8c41-60c9257b9f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:46.991996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d3b4eb29-3dd1-4891-8c41-60c9257b9f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:47.000918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:47.006806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d3b4eb29-3dd1-4891-8c41-60c9257b9f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.007621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d3b4eb29-3dd1-4891-8c41-60c9257b9f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.008629 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d3b4eb29-3dd1-4891-8c41-60c9257b9f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.009256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d3b4eb29-3dd1-4891-8c41-60c9257b9f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.016968 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.348202 May 28 14:23:47.017859 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 152/280] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:46 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:47.496082 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d3b4eb29-3dd1-4891-8c41-60c9257b9f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.517098 May 28 14:23:47.496742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 129/281] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:46 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:48.047585 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:48.048257 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:48.055640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.056103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.056889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.057333 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.270058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:48.278583 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1501 microversion: 2.1 time: 0.234696 May 28 14:23:48.279186 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 153/282] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:48 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:48.296570 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eca898c1-7894-44c3-986b-09aa7d949644"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:48.302871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:48.306600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.307248 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.308218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.308504 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.381006 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] HTTP exception thrown: Cannot 'attach_volume' instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f while it is in vm_state rescued May 28 14:23:48.381814 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Returning 409 to user: Cannot 'attach_volume' instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f while it is in vm_state rescued {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:23:48.382884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7a2d2623-bfab-43c7-9c83-0b4acf7806c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091072 May 28 14:23:48.383960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 130/283] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:23:48 2021] POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/os-volume_attachments => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 14:23:48.392520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-da600fb5-1ef7-4404-85bb-0834a835cc50 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:48.393076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-da600fb5-1ef7-4404-85bb-0834a835cc50 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:48.400490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da600fb5-1ef7-4404-85bb-0834a835cc50 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.400964 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da600fb5-1ef7-4404-85bb-0834a835cc50 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.401766 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da600fb5-1ef7-4404-85bb-0834a835cc50 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.402217 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da600fb5-1ef7-4404-85bb-0834a835cc50 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.508926 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-70b93c77-5615-4910-9e28-cb7e9c2d1981 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:48.509860 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-70b93c77-5615-4910-9e28-cb7e9c2d1981 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:48.517798 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70b93c77-5615-4910-9e28-cb7e9c2d1981 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.518280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70b93c77-5615-4910-9e28-cb7e9c2d1981 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.519191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70b93c77-5615-4910-9e28-cb7e9c2d1981 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.519888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70b93c77-5615-4910-9e28-cb7e9c2d1981 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.712204 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-da600fb5-1ef7-4404-85bb-0834a835cc50 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action" status: 202 len: 0 microversion: 2.1 time: 0.323261 May 28 14:23:48.713072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 154/284] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:23:48 2021] POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:48.722230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:48.726414 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:48.730293 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.730755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.731590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.732116 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.938121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:48.948182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.230647 May 28 14:23:48.948899 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 155/285] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:48 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:49.966953 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:49.967644 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:49.974984 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:49.975448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:49.976297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:49.976756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:50.177136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:50.196958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.222325 May 28 14:23:50.196958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 156/286] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:49 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:51.205097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-288c6078-e1ad-4c69-8a98-64168b4a356c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:51.205097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-288c6078-e1ad-4c69-8a98-64168b4a356c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:51.211483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-288c6078-e1ad-4c69-8a98-64168b4a356c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:51.211976 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-288c6078-e1ad-4c69-8a98-64168b4a356c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:51.212772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-288c6078-e1ad-4c69-8a98-64168b4a356c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:51.213215 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-288c6078-e1ad-4c69-8a98-64168b4a356c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:51.424874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-288c6078-e1ad-4c69-8a98-64168b4a356c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:51.433143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-288c6078-e1ad-4c69-8a98-64168b4a356c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.233815 May 28 14:23:51.434082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 157/287] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:51 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:52.452016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:52.452656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:52.460737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:52.466569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:52.466569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:52.466569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:52.725156 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:52.733395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.285292 May 28 14:23:52.733966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 158/288] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:52 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:53.620708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-70b93c77-5615-4910-9e28-cb7e9c2d1981 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 5.115203 May 28 14:23:53.625333 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 131/289] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:48 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 5118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:53.750269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e36e3d74-613f-413a-89e5-34c1cd973f60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:53.757416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e36e3d74-613f-413a-89e5-34c1cd973f60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:53.759343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e36e3d74-613f-413a-89e5-34c1cd973f60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:53.759844 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e36e3d74-613f-413a-89e5-34c1cd973f60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:53.760639 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e36e3d74-613f-413a-89e5-34c1cd973f60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:53.761081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e36e3d74-613f-413a-89e5-34c1cd973f60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:54.128748 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e36e3d74-613f-413a-89e5-34c1cd973f60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:54.140555 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e36e3d74-613f-413a-89e5-34c1cd973f60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.394078 May 28 14:23:54.141241 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 159/290] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:53 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:54.633846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-59704069-7345-451f-928d-e9e7abc6c904 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:54.635014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-59704069-7345-451f-928d-e9e7abc6c904 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:54.642914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-59704069-7345-451f-928d-e9e7abc6c904 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:54.643369 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-59704069-7345-451f-928d-e9e7abc6c904 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:54.644261 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-59704069-7345-451f-928d-e9e7abc6c904 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:54.644720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-59704069-7345-451f-928d-e9e7abc6c904 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:54.771891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-59704069-7345-451f-928d-e9e7abc6c904 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.141973 May 28 14:23:54.776237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 132/291] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:54 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:55.157681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:55.158316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:55.171946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:55.171946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:55.171946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:55.171946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:55.388540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:55.397473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.243588 May 28 14:23:55.398075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 160/292] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:55 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:55.785340 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e3c8bde0-ae87-4412-856a-0899ea1ac063 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:55.786333 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e3c8bde0-ae87-4412-856a-0899ea1ac063 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:55.794325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3c8bde0-ae87-4412-856a-0899ea1ac063 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:55.794847 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3c8bde0-ae87-4412-856a-0899ea1ac063 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:55.795668 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3c8bde0-ae87-4412-856a-0899ea1ac063 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:55.796210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3c8bde0-ae87-4412-856a-0899ea1ac063 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:56.036763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e3c8bde0-ae87-4412-856a-0899ea1ac063 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.255769 May 28 14:23:56.037437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 133/293] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:55 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:23:56.416863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-191a032f-8b73-4685-9416-239309f0376f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:56.417485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-191a032f-8b73-4685-9416-239309f0376f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:56.425275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-191a032f-8b73-4685-9416-239309f0376f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:56.425735 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-191a032f-8b73-4685-9416-239309f0376f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:56.426568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-191a032f-8b73-4685-9416-239309f0376f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:56.427031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-191a032f-8b73-4685-9416-239309f0376f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:56.634841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-191a032f-8b73-4685-9416-239309f0376f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:56.643778 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-191a032f-8b73-4685-9416-239309f0376f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.233656 May 28 14:23:56.644346 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 161/294] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:56 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:23:57.048932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9fb8407d-1d44-4fda-bcc6-a18636ac51f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:23:57.049974 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9fb8407d-1d44-4fda-bcc6-a18636ac51f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:57.057762 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9fb8407d-1d44-4fda-bcc6-a18636ac51f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:57.058225 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9fb8407d-1d44-4fda-bcc6-a18636ac51f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:57.059059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9fb8407d-1d44-4fda-bcc6-a18636ac51f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:57.059507 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9fb8407d-1d44-4fda-bcc6-a18636ac51f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:57.661447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d7b0f048-a718-472e-a689-033cd0c8edfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:57.662118 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d7b0f048-a718-472e-a689-033cd0c8edfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:57.669698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d7b0f048-a718-472e-a689-033cd0c8edfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:57.670209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d7b0f048-a718-472e-a689-033cd0c8edfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:57.671060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d7b0f048-a718-472e-a689-033cd0c8edfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:57.671509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d7b0f048-a718-472e-a689-033cd0c8edfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:57.872575 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d7b0f048-a718-472e-a689-033cd0c8edfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:57.881224 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d7b0f048-a718-472e-a689-033cd0c8edfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.224521 May 28 14:23:57.881803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 162/295] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:57 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:23:58.898582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:23:58.899438 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:23:58.906706 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:58.907166 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:58.907980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:58.908434 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:59.164516 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:23:59.174009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.279095 May 28 14:23:59.174660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 163/296] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:23:58 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:00.191162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-09562b00-093c-41b2-9b3f-024950a32d77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:00.191908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-09562b00-093c-41b2-9b3f-024950a32d77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:00.199657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-09562b00-093c-41b2-9b3f-024950a32d77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:00.200132 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-09562b00-093c-41b2-9b3f-024950a32d77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:00.202113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-09562b00-093c-41b2-9b3f-024950a32d77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:00.202113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-09562b00-093c-41b2-9b3f-024950a32d77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:00.475520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-09562b00-093c-41b2-9b3f-024950a32d77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:00.483928 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-09562b00-093c-41b2-9b3f-024950a32d77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.296698 May 28 14:24:00.484504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 164/297] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:00 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:01.502059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f017eeb0-7cea-407a-8471-554dce5ed6fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:01.502660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f017eeb0-7cea-407a-8471-554dce5ed6fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:01.509991 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f017eeb0-7cea-407a-8471-554dce5ed6fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:01.510452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f017eeb0-7cea-407a-8471-554dce5ed6fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:01.513874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f017eeb0-7cea-407a-8471-554dce5ed6fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:01.513874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f017eeb0-7cea-407a-8471-554dce5ed6fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:01.733912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f017eeb0-7cea-407a-8471-554dce5ed6fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:01.742459 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f017eeb0-7cea-407a-8471-554dce5ed6fa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.244277 May 28 14:24:01.743035 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 165/298] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:01 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:02.762194 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3c67b741-221a-4f12-a8e0-09c959a46e7a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:02.763106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3c67b741-221a-4f12-a8e0-09c959a46e7a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:02.771375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3c67b741-221a-4f12-a8e0-09c959a46e7a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:02.771986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3c67b741-221a-4f12-a8e0-09c959a46e7a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:02.773027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3c67b741-221a-4f12-a8e0-09c959a46e7a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:02.773724 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3c67b741-221a-4f12-a8e0-09c959a46e7a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:02.825521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9fb8407d-1d44-4fda-bcc6-a18636ac51f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 5.780495 May 28 14:24:02.826241 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 134/299] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:23:57 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 5782 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:03.002327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3c67b741-221a-4f12-a8e0-09c959a46e7a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:03.013490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3c67b741-221a-4f12-a8e0-09c959a46e7a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.256745 May 28 14:24:03.014282 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 166/300] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:02 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:03.839829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-73160384-b020-4042-af49-6f2fb41c7361 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:03.840847 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-73160384-b020-4042-af49-6f2fb41c7361 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:03.849012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73160384-b020-4042-af49-6f2fb41c7361 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:03.849482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73160384-b020-4042-af49-6f2fb41c7361 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:03.850380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73160384-b020-4042-af49-6f2fb41c7361 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:03.850831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73160384-b020-4042-af49-6f2fb41c7361 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:04.031659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-90967fb1-b90c-40c5-aa0a-678c8f538205 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:04.034816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-90967fb1-b90c-40c5-aa0a-678c8f538205 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:04.042063 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-90967fb1-b90c-40c5-aa0a-678c8f538205 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:04.042527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-90967fb1-b90c-40c5-aa0a-678c8f538205 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:04.043318 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-90967fb1-b90c-40c5-aa0a-678c8f538205 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:04.046024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-90967fb1-b90c-40c5-aa0a-678c8f538205 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:04.084257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-73160384-b020-4042-af49-6f2fb41c7361 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.249245 May 28 14:24:04.085459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 135/301] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:03 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:04.263411 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-90967fb1-b90c-40c5-aa0a-678c8f538205 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:04.272238 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-90967fb1-b90c-40c5-aa0a-678c8f538205 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.244393 May 28 14:24:04.272916 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 167/302] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:04 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:05.100709 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2b3eec79-b6b0-4b18-882b-fc194bc1da8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:05.100709 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2b3eec79-b6b0-4b18-882b-fc194bc1da8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:05.108189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2b3eec79-b6b0-4b18-882b-fc194bc1da8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:05.108654 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2b3eec79-b6b0-4b18-882b-fc194bc1da8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:05.109480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2b3eec79-b6b0-4b18-882b-fc194bc1da8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:05.109933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2b3eec79-b6b0-4b18-882b-fc194bc1da8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:05.227410 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2b3eec79-b6b0-4b18-882b-fc194bc1da8d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.132426 May 28 14:24:05.231823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 136/303] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:05 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:05.289466 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d4c972ce-a552-4196-952f-21b55b0ebdf5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:05.290233 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d4c972ce-a552-4196-952f-21b55b0ebdf5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:05.298383 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4c972ce-a552-4196-952f-21b55b0ebdf5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:05.298967 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4c972ce-a552-4196-952f-21b55b0ebdf5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:05.299814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4c972ce-a552-4196-952f-21b55b0ebdf5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:05.300415 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4c972ce-a552-4196-952f-21b55b0ebdf5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:05.538173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d4c972ce-a552-4196-952f-21b55b0ebdf5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:05.547396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d4c972ce-a552-4196-952f-21b55b0ebdf5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1509 microversion: 2.1 time: 0.261552 May 28 14:24:05.548208 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 168/304] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:05 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1509 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:06.239652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e885cb72-7b3c-4b71-997d-5effdb0173b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:06.240575 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e885cb72-7b3c-4b71-997d-5effdb0173b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:06.248989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e885cb72-7b3c-4b71-997d-5effdb0173b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:06.249443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e885cb72-7b3c-4b71-997d-5effdb0173b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:06.250216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e885cb72-7b3c-4b71-997d-5effdb0173b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:06.250653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e885cb72-7b3c-4b71-997d-5effdb0173b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:06.360552 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e885cb72-7b3c-4b71-997d-5effdb0173b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.125134 May 28 14:24:06.364874 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 137/305] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:06 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:06.566518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5698fc9c-d42e-4f10-9469-7605b77fe743 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:06.567316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5698fc9c-d42e-4f10-9469-7605b77fe743 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:06.579804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5698fc9c-d42e-4f10-9469-7605b77fe743 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:06.579804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5698fc9c-d42e-4f10-9469-7605b77fe743 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:06.579804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5698fc9c-d42e-4f10-9469-7605b77fe743 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:06.580330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5698fc9c-d42e-4f10-9469-7605b77fe743 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:06.806504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5698fc9c-d42e-4f10-9469-7605b77fe743 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:06.815668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5698fc9c-d42e-4f10-9469-7605b77fe743 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1515 microversion: 2.1 time: 0.253783 May 28 14:24:06.816499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 169/306] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:06 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:07.372762 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-00aad372-839a-4006-a5c2-f3b7ed9637b5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:07.376982 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-00aad372-839a-4006-a5c2-f3b7ed9637b5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:07.382070 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-00aad372-839a-4006-a5c2-f3b7ed9637b5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:07.382530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-00aad372-839a-4006-a5c2-f3b7ed9637b5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:07.383319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-00aad372-839a-4006-a5c2-f3b7ed9637b5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:07.383963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-00aad372-839a-4006-a5c2-f3b7ed9637b5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:07.498499 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-00aad372-839a-4006-a5c2-f3b7ed9637b5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.129732 May 28 14:24:07.499161 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 138/307] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:07 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:08.510515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b1dd04ee-a6da-4cf0-b6db-7a6bc9b7b0de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:08.511523 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b1dd04ee-a6da-4cf0-b6db-7a6bc9b7b0de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:08.519470 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b1dd04ee-a6da-4cf0-b6db-7a6bc9b7b0de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:08.519960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b1dd04ee-a6da-4cf0-b6db-7a6bc9b7b0de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:08.520756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b1dd04ee-a6da-4cf0-b6db-7a6bc9b7b0de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:08.521255 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b1dd04ee-a6da-4cf0-b6db-7a6bc9b7b0de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:08.643120 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b1dd04ee-a6da-4cf0-b6db-7a6bc9b7b0de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28220 microversion: 2.20 time: 0.136200 May 28 14:24:08.644057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 170/308] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:08 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:09.656242 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dbe0f35f-dc49-4fb4-b37b-e1302ef56518 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:09.657484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dbe0f35f-dc49-4fb4-b37b-e1302ef56518 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:09.665476 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbe0f35f-dc49-4fb4-b37b-e1302ef56518 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:09.665932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbe0f35f-dc49-4fb4-b37b-e1302ef56518 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:09.666793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbe0f35f-dc49-4fb4-b37b-e1302ef56518 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:09.667265 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbe0f35f-dc49-4fb4-b37b-e1302ef56518 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:09.955638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dbe0f35f-dc49-4fb4-b37b-e1302ef56518 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28511 microversion: 2.20 time: 0.303468 May 28 14:24:09.960042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 139/309] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:09 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:10.153908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:10.156389 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:10.164420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:10.164845 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:10.165771 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:10.168761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:10.460368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:10.468796 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1515 microversion: 2.1 time: 0.319211 May 28 14:24:10.469992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 171/310] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:10 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1515 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:10.486419 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-05e11a85-b942-49e3-a269-8f5d2dedd175 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf887260-79ad-47a1-9ae3-a0828186db30"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:10.487678 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-05e11a85-b942-49e3-a269-8f5d2dedd175 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:10.498143 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-05e11a85-b942-49e3-a269-8f5d2dedd175 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:10.498610 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-05e11a85-b942-49e3-a269-8f5d2dedd175 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:10.499452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-05e11a85-b942-49e3-a269-8f5d2dedd175 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:10.499931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-05e11a85-b942-49e3-a269-8f5d2dedd175 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:10.967403 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3b16a840-1a5b-439d-ae08-e78e8aadc446 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:10.968392 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3b16a840-1a5b-439d-ae08-e78e8aadc446 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:10.976165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b16a840-1a5b-439d-ae08-e78e8aadc446 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:10.986404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b16a840-1a5b-439d-ae08-e78e8aadc446 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:10.986404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b16a840-1a5b-439d-ae08-e78e8aadc446 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:10.986404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b16a840-1a5b-439d-ae08-e78e8aadc446 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:15.547830 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3b16a840-1a5b-439d-ae08-e78e8aadc446 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 28723 microversion: 2.20 time: 4.583348 May 28 14:24:15.552498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 172/311] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:10 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 28723 bytes in 4586 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:16.233244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-05e11a85-b942-49e3-a269-8f5d2dedd175 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.750891 May 28 14:24:16.233787 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 140/312] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:24:10 2021] POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/os-volume_attachments => generated 194 bytes in 5753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:24:16.560979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-911c37cf-329c-4c4e-85e4-46b19e53f691 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:16.561992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-911c37cf-329c-4c4e-85e4-46b19e53f691 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:16.570786 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-911c37cf-329c-4c4e-85e4-46b19e53f691 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:16.571240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-911c37cf-329c-4c4e-85e4-46b19e53f691 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:16.572071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-911c37cf-329c-4c4e-85e4-46b19e53f691 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:16.572517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-911c37cf-329c-4c4e-85e4-46b19e53f691 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:16.689310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-911c37cf-329c-4c4e-85e4-46b19e53f691 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29021 microversion: 2.20 time: 0.132301 May 28 14:24:16.689958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 173/313] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:16 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29021 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:17.701906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ddd15d1d-c666-4f4e-b6d3-821840eebdd4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:17.704547 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ddd15d1d-c666-4f4e-b6d3-821840eebdd4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:17.713749 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ddd15d1d-c666-4f4e-b6d3-821840eebdd4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:17.714211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ddd15d1d-c666-4f4e-b6d3-821840eebdd4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:17.715091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ddd15d1d-c666-4f4e-b6d3-821840eebdd4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:17.715495 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ddd15d1d-c666-4f4e-b6d3-821840eebdd4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:17.838069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ddd15d1d-c666-4f4e-b6d3-821840eebdd4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29229 microversion: 2.20 time: 0.140569 May 28 14:24:17.838737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 141/314] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:17 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29229 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:18.850177 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-29e91d70-1df3-41c6-b6ec-40a1420a7da3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:18.851198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-29e91d70-1df3-41c6-b6ec-40a1420a7da3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:18.859188 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-29e91d70-1df3-41c6-b6ec-40a1420a7da3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:18.860187 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-29e91d70-1df3-41c6-b6ec-40a1420a7da3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:18.860993 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-29e91d70-1df3-41c6-b6ec-40a1420a7da3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:18.861440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-29e91d70-1df3-41c6-b6ec-40a1420a7da3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:19.020113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-29e91d70-1df3-41c6-b6ec-40a1420a7da3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29496 microversion: 2.20 time: 0.174399 May 28 14:24:19.021028 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 174/315] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:18 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29496 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:20.032511 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0594d959-b79e-434e-97bc-e6a881a19f05 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:20.033638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0594d959-b79e-434e-97bc-e6a881a19f05 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:20.041652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0594d959-b79e-434e-97bc-e6a881a19f05 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:20.042144 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0594d959-b79e-434e-97bc-e6a881a19f05 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:20.042935 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0594d959-b79e-434e-97bc-e6a881a19f05 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:20.043389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0594d959-b79e-434e-97bc-e6a881a19f05 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:20.147031 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0594d959-b79e-434e-97bc-e6a881a19f05 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.118515 May 28 14:24:20.147627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 142/316] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:20 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:21.160576 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-963ba6f9-7764-40fa-9ec6-785dc3dd2773 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:21.161593 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-963ba6f9-7764-40fa-9ec6-785dc3dd2773 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:21.170042 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-963ba6f9-7764-40fa-9ec6-785dc3dd2773 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:21.170506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-963ba6f9-7764-40fa-9ec6-785dc3dd2773 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:21.171324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-963ba6f9-7764-40fa-9ec6-785dc3dd2773 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:21.171798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-963ba6f9-7764-40fa-9ec6-785dc3dd2773 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:21.286567 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-963ba6f9-7764-40fa-9ec6-785dc3dd2773 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.130835 May 28 14:24:21.287134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 175/317] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:21 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:22.299439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-acedd3c3-bdfe-45e7-a77b-1e9fca5b0d68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:22.300705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-acedd3c3-bdfe-45e7-a77b-1e9fca5b0d68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:22.309060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acedd3c3-bdfe-45e7-a77b-1e9fca5b0d68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:22.309615 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acedd3c3-bdfe-45e7-a77b-1e9fca5b0d68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:22.310421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acedd3c3-bdfe-45e7-a77b-1e9fca5b0d68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:22.310870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acedd3c3-bdfe-45e7-a77b-1e9fca5b0d68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:22.433197 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-acedd3c3-bdfe-45e7-a77b-1e9fca5b0d68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.138341 May 28 14:24:22.437120 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 143/318] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:22 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:23.445831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c742447e-2c44-44a0-95d5-790e101f3cc8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:23.446856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c742447e-2c44-44a0-95d5-790e101f3cc8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:23.455545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c742447e-2c44-44a0-95d5-790e101f3cc8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:23.456061 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c742447e-2c44-44a0-95d5-790e101f3cc8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:23.456807 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c742447e-2c44-44a0-95d5-790e101f3cc8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:23.457261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c742447e-2c44-44a0-95d5-790e101f3cc8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:23.573131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c742447e-2c44-44a0-95d5-790e101f3cc8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.131198 May 28 14:24:23.575102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 176/319] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:23 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:24.171052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1103840665", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "0d994a91-584d-47dc-9f6d-eb7159fb0da8"}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:24.589065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c3eb0dff-b0c6-4d87-9e1a-a261bac48374 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:24.590089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c3eb0dff-b0c6-4d87-9e1a-a261bac48374 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:24.598833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c3eb0dff-b0c6-4d87-9e1a-a261bac48374 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:24.599295 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c3eb0dff-b0c6-4d87-9e1a-a261bac48374 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:24.600127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c3eb0dff-b0c6-4d87-9e1a-a261bac48374 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:24.601451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c3eb0dff-b0c6-4d87-9e1a-a261bac48374 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:32.874846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:24:32.875437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:24:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 28 14:24:33.153763 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c3eb0dff-b0c6-4d87-9e1a-a261bac48374 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 8.571220 May 28 14:24:33.154675 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 177/320] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:24 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 8574 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:34.167436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cf02e3dc-c36b-4df3-939b-e6afb39a4af2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:34.169329 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cf02e3dc-c36b-4df3-939b-e6afb39a4af2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:34.179879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cf02e3dc-c36b-4df3-939b-e6afb39a4af2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:34.180539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cf02e3dc-c36b-4df3-939b-e6afb39a4af2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:34.181347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cf02e3dc-c36b-4df3-939b-e6afb39a4af2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:34.181794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cf02e3dc-c36b-4df3-939b-e6afb39a4af2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:34.298181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cf02e3dc-c36b-4df3-939b-e6afb39a4af2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.134836 May 28 14:24:34.301650 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 178/321] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:34 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:35.311318 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-654f93dc-af0f-4c03-854c-2387b37b6584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:35.313511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-654f93dc-af0f-4c03-854c-2387b37b6584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:35.326600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-654f93dc-af0f-4c03-854c-2387b37b6584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:35.326600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-654f93dc-af0f-4c03-854c-2387b37b6584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:35.326600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-654f93dc-af0f-4c03-854c-2387b37b6584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:35.326600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-654f93dc-af0f-4c03-854c-2387b37b6584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:35.447125 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-654f93dc-af0f-4c03-854c-2387b37b6584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.140227 May 28 14:24:35.447695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 179/322] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:35 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:36.459765 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-abbc66f3-e22e-46ff-859f-3dda348cfe80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:36.460725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-abbc66f3-e22e-46ff-859f-3dda348cfe80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:36.469648 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abbc66f3-e22e-46ff-859f-3dda348cfe80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:36.470397 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abbc66f3-e22e-46ff-859f-3dda348cfe80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:36.481248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abbc66f3-e22e-46ff-859f-3dda348cfe80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:36.481248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abbc66f3-e22e-46ff-859f-3dda348cfe80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:36.600277 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-abbc66f3-e22e-46ff-859f-3dda348cfe80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.144286 May 28 14:24:36.600946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 180/323] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:36 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:37.613637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-865818e0-dc2b-4fd8-8b06-14ade041ea8a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:37.614666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-865818e0-dc2b-4fd8-8b06-14ade041ea8a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:37.623024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-865818e0-dc2b-4fd8-8b06-14ade041ea8a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:37.623545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-865818e0-dc2b-4fd8-8b06-14ade041ea8a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:37.624327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-865818e0-dc2b-4fd8-8b06-14ade041ea8a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:37.624780 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-865818e0-dc2b-4fd8-8b06-14ade041ea8a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:37.729426 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-865818e0-dc2b-4fd8-8b06-14ade041ea8a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.120296 May 28 14:24:37.730113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 181/324] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:37 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:38.742880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8cf2f942-e530-46a3-b4c8-abe66cbd8102 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:38.744624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8cf2f942-e530-46a3-b4c8-abe66cbd8102 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:38.753016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cf2f942-e530-46a3-b4c8-abe66cbd8102 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:38.753476 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cf2f942-e530-46a3-b4c8-abe66cbd8102 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:38.754263 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cf2f942-e530-46a3-b4c8-abe66cbd8102 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:38.755163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cf2f942-e530-46a3-b4c8-abe66cbd8102 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:38.861452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8cf2f942-e530-46a3-b4c8-abe66cbd8102 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.123418 May 28 14:24:38.862117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 182/325] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:38 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:38.879076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:24:38.879694 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:24:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 28 14:24:39.459156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] validate_networks() for [('0d994a91-584d-47dc-9f6d-eb7159fb0da8', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:24:39.874086 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4bb463cb-0cea-444c-993b-edb54f4c8ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:39.875867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4bb463cb-0cea-444c-993b-edb54f4c8ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:39.884423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4bb463cb-0cea-444c-993b-edb54f4c8ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:39.884881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4bb463cb-0cea-444c-993b-edb54f4c8ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:39.885672 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4bb463cb-0cea-444c-993b-edb54f4c8ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:39.886116 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4bb463cb-0cea-444c-993b-edb54f4c8ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:39.998662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4bb463cb-0cea-444c-993b-edb54f4c8ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.128603 May 28 14:24:40.000247 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 183/326] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:39 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:40.114048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:24:40.116720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:24:40.117218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:24:40.117637 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:24:40.118063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:24:40.127100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:40.127572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:40.128415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:40.128864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:40.146366 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Getting quotas for project eba85ed1a1a14a848b3f33435440dff1. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:24:40.151312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Getting quotas for user abfb66238fe64034b35f81b0f7e76fc2 and project eba85ed1a1a14a848b3f33435440dff1. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:24:40.161041 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:24:40.163459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:24:40.511400 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a51801a3-2021-402e-9c45-bedcf03e50e9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.344251 May 28 14:24:40.512004 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 144/327] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:24:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 16346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:24:40.522802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3b1cb578-5c93-46e8-9afe-876f75c1c327 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:40.523571 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3b1cb578-5c93-46e8-9afe-876f75c1c327 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:40.635440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3b1cb578-5c93-46e8-9afe-876f75c1c327 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:40.644112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3b1cb578-5c93-46e8-9afe-876f75c1c327 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1214 microversion: 2.1 time: 0.125431 May 28 14:24:40.657497 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 184/328] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:40 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:41.010332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-229abbcb-a771-4cd0-a493-89faca98952e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:41.011385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-229abbcb-a771-4cd0-a493-89faca98952e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:41.019658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-229abbcb-a771-4cd0-a493-89faca98952e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:41.020056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-229abbcb-a771-4cd0-a493-89faca98952e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:41.020921 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-229abbcb-a771-4cd0-a493-89faca98952e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:41.021358 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-229abbcb-a771-4cd0-a493-89faca98952e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:41.132511 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-229abbcb-a771-4cd0-a493-89faca98952e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.125771 May 28 14:24:41.133159 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 145/329] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:41 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:41.665314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8bb2665a-49be-4a47-a914-50ea7d9aec98 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:41.665941 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8bb2665a-49be-4a47-a914-50ea7d9aec98 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:41.739866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8bb2665a-49be-4a47-a914-50ea7d9aec98 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:41.748082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8bb2665a-49be-4a47-a914-50ea7d9aec98 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1214 microversion: 2.1 time: 0.086699 May 28 14:24:41.748827 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 185/330] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:41 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:42.144804 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ca042647-ccc0-4e0b-9d55-2f70786605c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:42.145884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ca042647-ccc0-4e0b-9d55-2f70786605c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:42.153891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca042647-ccc0-4e0b-9d55-2f70786605c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:42.157082 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca042647-ccc0-4e0b-9d55-2f70786605c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:42.157082 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca042647-ccc0-4e0b-9d55-2f70786605c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:42.157082 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca042647-ccc0-4e0b-9d55-2f70786605c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:42.277737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ca042647-ccc0-4e0b-9d55-2f70786605c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.136921 May 28 14:24:42.278390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 146/331] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:42 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:42.766499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:42.767123 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:42.774539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:42.774997 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:42.775820 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:42.776262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:42.908017 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:42.920517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1210 microversion: 2.1 time: 0.158293 May 28 14:24:42.923787 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 186/332] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:42 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1210 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:43.292053 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6bd47fee-8dbd-40bc-b56c-24073fa98f78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:43.293056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6bd47fee-8dbd-40bc-b56c-24073fa98f78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:43.301185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6bd47fee-8dbd-40bc-b56c-24073fa98f78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:43.301645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6bd47fee-8dbd-40bc-b56c-24073fa98f78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:43.302432 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6bd47fee-8dbd-40bc-b56c-24073fa98f78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:43.302873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6bd47fee-8dbd-40bc-b56c-24073fa98f78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:43.484891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6bd47fee-8dbd-40bc-b56c-24073fa98f78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.197696 May 28 14:24:43.485636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 147/333] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:43 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:43.783711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-df82ac5b-96cf-4b60-9454-690e740c7c4f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:43.784766 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-df82ac5b-96cf-4b60-9454-690e740c7c4f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:43.792594 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-df82ac5b-96cf-4b60-9454-690e740c7c4f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:43.793055 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-df82ac5b-96cf-4b60-9454-690e740c7c4f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:43.793851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-df82ac5b-96cf-4b60-9454-690e740c7c4f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:43.794300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-df82ac5b-96cf-4b60-9454-690e740c7c4f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:43.854847 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-df82ac5b-96cf-4b60-9454-690e740c7c4f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lazy-loading 'flavor' on Instance uuid 9c17d712-c03d-44ac-bd8d-5f9b99160b0f {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:24:43.932227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:24:43.932653 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: Fri May 28 14:24:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action (ip 10.222.0.59) !!! May 28 14:24:43.953425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:43.955900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:43.971231 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:43.973545 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:43.975402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:43.976091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.119889 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:44.128837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1266 microversion: 2.1 time: 0.188753 May 28 14:24:44.130330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 148/334] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:43 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:44.455604 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-df82ac5b-96cf-4b60-9454-690e740c7c4f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action" status: 200 len: 32 microversion: 2.1 time: 0.675497 May 28 14:24:44.456061 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 187/335] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:24:43 2021] POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action => generated 32 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:24:44.465048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:44.465727 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:44.472893 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:44.473352 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.474130 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:44.474570 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.497495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7e22b142-a5d2-4f36-9d97-e548f20d6ed2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:44.498420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7e22b142-a5d2-4f36-9d97-e548f20d6ed2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:44.507384 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e22b142-a5d2-4f36-9d97-e548f20d6ed2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:44.508049 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e22b142-a5d2-4f36-9d97-e548f20d6ed2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.509023 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e22b142-a5d2-4f36-9d97-e548f20d6ed2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:44.509721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e22b142-a5d2-4f36-9d97-e548f20d6ed2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.679446 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:44.688711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.227323 May 28 14:24:44.689274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 149/336] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:44 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:45.147085 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-634208ae-9f28-48c7-8b17-362756468f11 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:45.147770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-634208ae-9f28-48c7-8b17-362756468f11 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:45.155617 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-634208ae-9f28-48c7-8b17-362756468f11 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:45.156651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-634208ae-9f28-48c7-8b17-362756468f11 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:45.157554 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-634208ae-9f28-48c7-8b17-362756468f11 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:45.158005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-634208ae-9f28-48c7-8b17-362756468f11 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:45.275344 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-634208ae-9f28-48c7-8b17-362756468f11 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:45.286836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-634208ae-9f28-48c7-8b17-362756468f11 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1266 microversion: 2.1 time: 0.143469 May 28 14:24:45.296098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 150/337] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:45 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:45.715643 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:45.716868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:45.725621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:45.726204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:45.727201 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:45.728035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:45.936455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:45.945426 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.233811 May 28 14:24:45.946003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 151/338] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:45 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:46.303658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5e3406b5-16ca-4d80-9784-93aff3d5756a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:46.304291 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5e3406b5-16ca-4d80-9784-93aff3d5756a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:46.311808 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e3406b5-16ca-4d80-9784-93aff3d5756a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:46.312323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e3406b5-16ca-4d80-9784-93aff3d5756a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:46.313124 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e3406b5-16ca-4d80-9784-93aff3d5756a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:46.313572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e3406b5-16ca-4d80-9784-93aff3d5756a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:46.439545 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5e3406b5-16ca-4d80-9784-93aff3d5756a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:46.448362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5e3406b5-16ca-4d80-9784-93aff3d5756a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1274 microversion: 2.1 time: 0.148520 May 28 14:24:46.453350 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 152/339] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:46 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:46.962881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-09fb413a-2bd5-4734-895a-bffc82043ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:46.963498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-09fb413a-2bd5-4734-895a-bffc82043ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:46.970939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-09fb413a-2bd5-4734-895a-bffc82043ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:46.971312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-09fb413a-2bd5-4734-895a-bffc82043ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:46.972133 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-09fb413a-2bd5-4734-895a-bffc82043ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:46.972586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-09fb413a-2bd5-4734-895a-bffc82043ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:47.228685 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-09fb413a-2bd5-4734-895a-bffc82043ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:47.243027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-09fb413a-2bd5-4734-895a-bffc82043ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.283874 May 28 14:24:47.245319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 153/340] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:46 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:47.467943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:47.470657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:47.477995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:47.478391 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:47.479185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:47.479657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:47.595053 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:47.603574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1274 microversion: 2.1 time: 0.139296 May 28 14:24:47.604154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 154/341] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:47 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:48.186481 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7e22b142-a5d2-4f36-9d97-e548f20d6ed2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 3.692823 May 28 14:24:48.187617 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 188/342] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:44 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 3695 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:48.260926 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5c22f858-53df-4c6a-b0b5-442dda71bb4c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:48.261589 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5c22f858-53df-4c6a-b0b5-442dda71bb4c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:48.269607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5c22f858-53df-4c6a-b0b5-442dda71bb4c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:48.270048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5c22f858-53df-4c6a-b0b5-442dda71bb4c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:48.270838 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5c22f858-53df-4c6a-b0b5-442dda71bb4c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:48.271282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5c22f858-53df-4c6a-b0b5-442dda71bb4c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:48.483138 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5c22f858-53df-4c6a-b0b5-442dda71bb4c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:48.493202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5c22f858-53df-4c6a-b0b5-442dda71bb4c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.236025 May 28 14:24:48.493793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 155/343] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:48 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:48.622076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:48.622802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:48.631197 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:48.631709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:48.632508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:48.632954 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:48.844729 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:48.853175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1274 microversion: 2.1 time: 0.235485 May 28 14:24:48.853752 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 189/344] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:48 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:49.198466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1dfe584b-e600-4485-98ba-b3c27735cd71 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:49.199471 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1dfe584b-e600-4485-98ba-b3c27735cd71 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:49.207133 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1dfe584b-e600-4485-98ba-b3c27735cd71 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:49.207625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1dfe584b-e600-4485-98ba-b3c27735cd71 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:49.208455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1dfe584b-e600-4485-98ba-b3c27735cd71 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:49.208905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1dfe584b-e600-4485-98ba-b3c27735cd71 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:49.336674 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1dfe584b-e600-4485-98ba-b3c27735cd71 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.141796 May 28 14:24:49.337472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 156/345] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:49 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:49.522332 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-63685f05-a30d-4e91-a317-21e9070fd355 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:49.522332 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-63685f05-a30d-4e91-a317-21e9070fd355 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:49.522332 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-63685f05-a30d-4e91-a317-21e9070fd355 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:49.522332 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-63685f05-a30d-4e91-a317-21e9070fd355 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:49.523038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-63685f05-a30d-4e91-a317-21e9070fd355 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:49.523038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-63685f05-a30d-4e91-a317-21e9070fd355 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:49.873125 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-61de225b-6f0f-4485-a9b1-13e5592564d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:49.874179 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-61de225b-6f0f-4485-a9b1-13e5592564d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:49.883202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-61de225b-6f0f-4485-a9b1-13e5592564d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:49.883785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-61de225b-6f0f-4485-a9b1-13e5592564d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:49.884567 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-61de225b-6f0f-4485-a9b1-13e5592564d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:49.884995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-61de225b-6f0f-4485-a9b1-13e5592564d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:49.948261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-63685f05-a30d-4e91-a317-21e9070fd355 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:49.959626 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-63685f05-a30d-4e91-a317-21e9070fd355 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.452475 May 28 14:24:49.960267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 190/346] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:49 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:50.007772 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-61de225b-6f0f-4485-a9b1-13e5592564d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:50.016594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-61de225b-6f0f-4485-a9b1-13e5592564d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1272 microversion: 2.1 time: 0.148141 May 28 14:24:50.017171 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 157/347] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:49 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:50.348992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3f6ed524-e6fe-4fc9-8c67-d207eb1c10e4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:50.349929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3f6ed524-e6fe-4fc9-8c67-d207eb1c10e4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:50.357520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3f6ed524-e6fe-4fc9-8c67-d207eb1c10e4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:50.358009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3f6ed524-e6fe-4fc9-8c67-d207eb1c10e4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:50.358863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3f6ed524-e6fe-4fc9-8c67-d207eb1c10e4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:50.359309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3f6ed524-e6fe-4fc9-8c67-d207eb1c10e4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:50.496581 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3f6ed524-e6fe-4fc9-8c67-d207eb1c10e4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.151486 May 28 14:24:50.503358 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 191/348] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:50 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:50.979455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-029f305e-065f-463c-810d-71a26b306acf tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:50.979455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-029f305e-065f-463c-810d-71a26b306acf tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:50.988688 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-029f305e-065f-463c-810d-71a26b306acf tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:50.989151 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-029f305e-065f-463c-810d-71a26b306acf tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:50.989945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-029f305e-065f-463c-810d-71a26b306acf tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:50.990416 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-029f305e-065f-463c-810d-71a26b306acf tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:51.036503 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-813b547b-0144-4946-8ecd-a21e6d13022e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:51.039440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-813b547b-0144-4946-8ecd-a21e6d13022e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:51.053600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-813b547b-0144-4946-8ecd-a21e6d13022e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:51.055077 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-813b547b-0144-4946-8ecd-a21e6d13022e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:51.055503 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-813b547b-0144-4946-8ecd-a21e6d13022e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:51.056161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-813b547b-0144-4946-8ecd-a21e6d13022e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:51.249535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-029f305e-065f-463c-810d-71a26b306acf tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:51.261630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-029f305e-065f-463c-810d-71a26b306acf tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.286088 May 28 14:24:51.262726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 158/349] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:50 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:51.509039 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-40a77831-fec5-4e08-9b6b-3d71e3c57b14 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:51.510016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-40a77831-fec5-4e08-9b6b-3d71e3c57b14 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:51.527764 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-40a77831-fec5-4e08-9b6b-3d71e3c57b14 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:51.528473 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-40a77831-fec5-4e08-9b6b-3d71e3c57b14 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:51.529434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-40a77831-fec5-4e08-9b6b-3d71e3c57b14 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:51.530027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-40a77831-fec5-4e08-9b6b-3d71e3c57b14 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:51.622018 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-813b547b-0144-4946-8ecd-a21e6d13022e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:51.636043 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-813b547b-0144-4946-8ecd-a21e6d13022e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.602775 May 28 14:24:51.638468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 192/350] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:51 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:51.673817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-40a77831-fec5-4e08-9b6b-3d71e3c57b14 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.168367 May 28 14:24:51.674717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 159/351] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:51 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:51.836835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-e1ae7f45-3511-47f8-97d1-605750e34e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a422bf7-82c2-409e-a573-929842d0cff3", "tag": "3c609de4-4752-48b6-81cf-9335e2a7a542"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:51.838718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:24:51.838718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:24:51.855210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-e1ae7f45-3511-47f8-97d1-605750e34e34 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:51.859701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-e1ae7f45-3511-47f8-97d1-605750e34e34 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:52.025615 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-e1ae7f45-3511-47f8-97d1-605750e34e34 service nova] Creating event network-changed:3c609de4-4752-48b6-81cf-9335e2a7a542 for instance 3a422bf7-82c2-409e-a573-929842d0cff3 on hv-cinder-79128 May 28 14:24:52.031433 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-e1ae7f45-3511-47f8-97d1-605750e34e34 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197828 May 28 14:24:52.032908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 193/352] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:24:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:24:52.278817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8ad5b07a-84c2-4bf1-9119-01f476800f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:52.279524 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8ad5b07a-84c2-4bf1-9119-01f476800f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:52.292135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8ad5b07a-84c2-4bf1-9119-01f476800f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:52.292135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8ad5b07a-84c2-4bf1-9119-01f476800f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:52.292477 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8ad5b07a-84c2-4bf1-9119-01f476800f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:52.292998 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8ad5b07a-84c2-4bf1-9119-01f476800f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:52.523918 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8ad5b07a-84c2-4bf1-9119-01f476800f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:52.539270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8ad5b07a-84c2-4bf1-9119-01f476800f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.264629 May 28 14:24:52.540282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 160/353] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:52 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:52.653552 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-19132cff-7980-4ee4-91be-98e8b312c4d9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:52.654287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-19132cff-7980-4ee4-91be-98e8b312c4d9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:52.662892 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19132cff-7980-4ee4-91be-98e8b312c4d9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:52.663337 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19132cff-7980-4ee4-91be-98e8b312c4d9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:52.667715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19132cff-7980-4ee4-91be-98e8b312c4d9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:52.667715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19132cff-7980-4ee4-91be-98e8b312c4d9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:52.685058 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-04ae3d87-8508-4963-936f-79d8c1601cff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:52.685994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-04ae3d87-8508-4963-936f-79d8c1601cff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:52.694813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04ae3d87-8508-4963-936f-79d8c1601cff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:52.695289 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04ae3d87-8508-4963-936f-79d8c1601cff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:52.696287 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04ae3d87-8508-4963-936f-79d8c1601cff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:52.696751 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04ae3d87-8508-4963-936f-79d8c1601cff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:53.040728 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-19132cff-7980-4ee4-91be-98e8b312c4d9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:53.051461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-19132cff-7980-4ee4-91be-98e8b312c4d9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.401560 May 28 14:24:53.058183 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 194/354] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:52 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:53.557273 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5c1fef28-4365-4e09-96a9-f85e635e0699 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:53.558011 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5c1fef28-4365-4e09-96a9-f85e635e0699 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:53.566028 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5c1fef28-4365-4e09-96a9-f85e635e0699 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:53.568038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5c1fef28-4365-4e09-96a9-f85e635e0699 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:53.568038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5c1fef28-4365-4e09-96a9-f85e635e0699 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:53.577593 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5c1fef28-4365-4e09-96a9-f85e635e0699 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:53.800690 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5c1fef28-4365-4e09-96a9-f85e635e0699 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:53.810463 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5c1fef28-4365-4e09-96a9-f85e635e0699 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.257014 May 28 14:24:53.811235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 195/355] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:53 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:53.838093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-04ae3d87-8508-4963-936f-79d8c1601cff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 1.156688 May 28 14:24:53.839187 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 161/356] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:52 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:24:54.069143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:54.069683 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:54.077144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:54.078150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:54.079132 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:54.079606 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:54.369751 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:54.375929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.310563 May 28 14:24:54.376497 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 196/357] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:54 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:54.829590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:54.830518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:54.839907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:54.856629 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:54.856629 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:54.856629 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:54.857190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8210d86e-0602-485d-9126-be15176c4aba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:54.857190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8210d86e-0602-485d-9126-be15176c4aba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:54.859811 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8210d86e-0602-485d-9126-be15176c4aba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:54.860379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8210d86e-0602-485d-9126-be15176c4aba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:54.861182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8210d86e-0602-485d-9126-be15176c4aba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:54.861656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8210d86e-0602-485d-9126-be15176c4aba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:55.064624 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:55.073731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.249188 May 28 14:24:55.074314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 162/358] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:54 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:55.096265 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8210d86e-0602-485d-9126-be15176c4aba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.249789 May 28 14:24:55.096921 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 197/359] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:54 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:55.393033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:55.402631 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:55.413217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:55.413673 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:55.414502 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:55.414948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:55.751311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:55.760774 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.371924 May 28 14:24:55.761644 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 163/360] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:55 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:56.091125 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7caf8c93-a985-4655-913e-da059b93e5ea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:56.092105 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7caf8c93-a985-4655-913e-da059b93e5ea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:56.100163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7caf8c93-a985-4655-913e-da059b93e5ea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:56.103432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7caf8c93-a985-4655-913e-da059b93e5ea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:56.103432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7caf8c93-a985-4655-913e-da059b93e5ea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:56.103432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7caf8c93-a985-4655-913e-da059b93e5ea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:56.109092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-82b3c6f3-aa32-4cca-a3f1-2a1c22c5ee5e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:56.110688 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-82b3c6f3-aa32-4cca-a3f1-2a1c22c5ee5e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:56.127753 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-82b3c6f3-aa32-4cca-a3f1-2a1c22c5ee5e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:56.128329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-82b3c6f3-aa32-4cca-a3f1-2a1c22c5ee5e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:56.129204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-82b3c6f3-aa32-4cca-a3f1-2a1c22c5ee5e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:56.129747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-82b3c6f3-aa32-4cca-a3f1-2a1c22c5ee5e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:56.293999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-82b3c6f3-aa32-4cca-a3f1-2a1c22c5ee5e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.189175 May 28 14:24:56.295393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 164/361] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:56 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:56.324231 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7caf8c93-a985-4655-913e-da059b93e5ea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:56.333245 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7caf8c93-a985-4655-913e-da059b93e5ea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.246319 May 28 14:24:56.333825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 198/362] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:56 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:56.780050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:56.780768 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:56.789288 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:56.789748 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:56.790561 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:56.791006 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:56.990338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:56.998902 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.223122 May 28 14:24:57.000097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 165/363] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:56 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:57.306656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b5e70509-abc5-48ce-9d4f-80b5f81fc629 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:57.307683 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b5e70509-abc5-48ce-9d4f-80b5f81fc629 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:57.315883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b5e70509-abc5-48ce-9d4f-80b5f81fc629 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:57.316463 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b5e70509-abc5-48ce-9d4f-80b5f81fc629 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:57.317480 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b5e70509-abc5-48ce-9d4f-80b5f81fc629 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:57.317923 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b5e70509-abc5-48ce-9d4f-80b5f81fc629 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:57.353423 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e10f247d-b5e5-47a2-93af-9c2914acd98f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:57.357983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e10f247d-b5e5-47a2-93af-9c2914acd98f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:57.366891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e10f247d-b5e5-47a2-93af-9c2914acd98f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:57.367736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e10f247d-b5e5-47a2-93af-9c2914acd98f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:57.368790 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e10f247d-b5e5-47a2-93af-9c2914acd98f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:57.369642 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e10f247d-b5e5-47a2-93af-9c2914acd98f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:57.426000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b5e70509-abc5-48ce-9d4f-80b5f81fc629 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.122983 May 28 14:24:57.426663 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 199/364] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:57 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:57.579521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e10f247d-b5e5-47a2-93af-9c2914acd98f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:57.588330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e10f247d-b5e5-47a2-93af-9c2914acd98f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.241463 May 28 14:24:57.588939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 166/365] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:57 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:58.017227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:58.017942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:58.026168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:58.026635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:58.027511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:58.028047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:58.323330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:58.333973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.320868 May 28 14:24:58.334717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 200/366] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:58 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:58.439537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3ae9578f-04e8-4eb0-80f6-66d33660f394 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:58.446965 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3ae9578f-04e8-4eb0-80f6-66d33660f394 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:58.462717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ae9578f-04e8-4eb0-80f6-66d33660f394 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:58.463183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ae9578f-04e8-4eb0-80f6-66d33660f394 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:58.466029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ae9578f-04e8-4eb0-80f6-66d33660f394 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:58.466422 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ae9578f-04e8-4eb0-80f6-66d33660f394 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:58.606065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:58.606689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:58.614500 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:58.614965 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:58.615793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:58.616241 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:58.669717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3ae9578f-04e8-4eb0-80f6-66d33660f394 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.234740 May 28 14:24:58.671998 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 167/367] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:58 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:58.831232 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:58.841084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.238445 May 28 14:24:58.842224 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 201/368] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:58 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:24:59.352182 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d47d149d-d2b0-4950-95df-1a05fd4861a3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:59.352896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d47d149d-d2b0-4950-95df-1a05fd4861a3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:59.360970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d47d149d-d2b0-4950-95df-1a05fd4861a3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:59.361389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d47d149d-d2b0-4950-95df-1a05fd4861a3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:59.362205 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d47d149d-d2b0-4950-95df-1a05fd4861a3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:59.362639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d47d149d-d2b0-4950-95df-1a05fd4861a3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:59.569713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d47d149d-d2b0-4950-95df-1a05fd4861a3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:24:59.583667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d47d149d-d2b0-4950-95df-1a05fd4861a3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.235378 May 28 14:24:59.584655 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 168/369] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:59 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:24:59.682592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7052598a-18b5-4eeb-871a-aa17f330b447 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:24:59.683526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7052598a-18b5-4eeb-871a-aa17f330b447 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:59.692291 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7052598a-18b5-4eeb-871a-aa17f330b447 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:59.692743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7052598a-18b5-4eeb-871a-aa17f330b447 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:59.693539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7052598a-18b5-4eeb-871a-aa17f330b447 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:59.693985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7052598a-18b5-4eeb-871a-aa17f330b447 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:59.805983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7052598a-18b5-4eeb-871a-aa17f330b447 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.126916 May 28 14:24:59.816614 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 202/370] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:24:59 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:24:59.859086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:24:59.859766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:24:59.867723 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:59.868364 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:59.869350 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:59.869958 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:00.081303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:00.090169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.235694 May 28 14:25:00.090736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 169/371] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:24:59 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:00.601300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-42d1b3a9-ca3a-4e27-8252-2907d7540619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:00.602001 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-42d1b3a9-ca3a-4e27-8252-2907d7540619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:00.610250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-42d1b3a9-ca3a-4e27-8252-2907d7540619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:00.610704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-42d1b3a9-ca3a-4e27-8252-2907d7540619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:00.611485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-42d1b3a9-ca3a-4e27-8252-2907d7540619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:00.611965 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-42d1b3a9-ca3a-4e27-8252-2907d7540619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:00.828955 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1102282b-bf89-4f27-bd51-045b81c76074 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:00.829900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1102282b-bf89-4f27-bd51-045b81c76074 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:00.839205 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1102282b-bf89-4f27-bd51-045b81c76074 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:00.839756 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1102282b-bf89-4f27-bd51-045b81c76074 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:00.840740 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1102282b-bf89-4f27-bd51-045b81c76074 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:00.841328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1102282b-bf89-4f27-bd51-045b81c76074 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:00.962895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-42d1b3a9-ca3a-4e27-8252-2907d7540619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:00.972123 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-42d1b3a9-ca3a-4e27-8252-2907d7540619 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.374931 May 28 14:25:00.972754 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 203/372] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:00 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:01.107950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e47263a0-c4ab-490e-9af1-e08b58b2d102 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:01.109481 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e47263a0-c4ab-490e-9af1-e08b58b2d102 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:01.118446 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e47263a0-c4ab-490e-9af1-e08b58b2d102 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:01.118632 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1102282b-bf89-4f27-bd51-045b81c76074 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.293687 May 28 14:25:01.119324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e47263a0-c4ab-490e-9af1-e08b58b2d102 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:01.120249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 170/373] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:00 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:01.120504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e47263a0-c4ab-490e-9af1-e08b58b2d102 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:01.120898 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e47263a0-c4ab-490e-9af1-e08b58b2d102 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:01.508102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e47263a0-c4ab-490e-9af1-e08b58b2d102 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:01.517275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e47263a0-c4ab-490e-9af1-e08b58b2d102 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.414419 May 28 14:25:01.517878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 204/374] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:01 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:01.992548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:01.994404 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:02.006738 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:02.007934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:02.009214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:02.010063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:02.134995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0d2340c1-6650-4115-9996-b0c8ee502c79 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:02.137627 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0d2340c1-6650-4115-9996-b0c8ee502c79 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:02.146558 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0d2340c1-6650-4115-9996-b0c8ee502c79 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:02.147012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0d2340c1-6650-4115-9996-b0c8ee502c79 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:02.147857 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0d2340c1-6650-4115-9996-b0c8ee502c79 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:02.148293 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0d2340c1-6650-4115-9996-b0c8ee502c79 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:02.269205 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:02.277716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.290929 May 28 14:25:02.278296 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 171/375] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:01 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:02.291709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0d2340c1-6650-4115-9996-b0c8ee502c79 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.160470 May 28 14:25:02.292357 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 205/376] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:02 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:02.534528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5c3be309-04e8-4484-a53d-2a2efbdb810f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:02.536440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5c3be309-04e8-4484-a53d-2a2efbdb810f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:02.542706 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5c3be309-04e8-4484-a53d-2a2efbdb810f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:02.543164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5c3be309-04e8-4484-a53d-2a2efbdb810f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:02.544471 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5c3be309-04e8-4484-a53d-2a2efbdb810f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:02.544471 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5c3be309-04e8-4484-a53d-2a2efbdb810f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:02.751008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5c3be309-04e8-4484-a53d-2a2efbdb810f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:02.760307 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5c3be309-04e8-4484-a53d-2a2efbdb810f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.229934 May 28 14:25:02.760920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 172/377] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:02 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:02.999235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-398068f4-5ac3-49b6-b513-d5ff7fe1f26d req-a10be2d2-bf06-49d7-8163-98becc9bbe9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a422bf7-82c2-409e-a573-929842d0cff3", "name": "network-vif-plugged", "status": "completed", "tag": "3c609de4-4752-48b6-81cf-9335e2a7a542"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:02.999235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:25:02.999235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:25:03.006753 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-398068f4-5ac3-49b6-b513-d5ff7fe1f26d req-a10be2d2-bf06-49d7-8163-98becc9bbe9b service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:03.007199 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-398068f4-5ac3-49b6-b513-d5ff7fe1f26d req-a10be2d2-bf06-49d7-8163-98becc9bbe9b service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:03.023578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-398068f4-5ac3-49b6-b513-d5ff7fe1f26d req-a10be2d2-bf06-49d7-8163-98becc9bbe9b service nova] Creating event network-vif-plugged:3c609de4-4752-48b6-81cf-9335e2a7a542 for instance 3a422bf7-82c2-409e-a573-929842d0cff3 on hv-cinder-79128 May 28 14:25:03.028254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-398068f4-5ac3-49b6-b513-d5ff7fe1f26d req-a10be2d2-bf06-49d7-8163-98becc9bbe9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036383 May 28 14:25:03.028853 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 206/378] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:25:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:25:03.294236 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6f22b762-c85b-425b-a297-9d81a695fe56 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:03.294903 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6f22b762-c85b-425b-a297-9d81a695fe56 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:03.303273 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f22b762-c85b-425b-a297-9d81a695fe56 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:03.303753 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f22b762-c85b-425b-a297-9d81a695fe56 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:03.304543 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f22b762-c85b-425b-a297-9d81a695fe56 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:03.305171 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f22b762-c85b-425b-a297-9d81a695fe56 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:03.305573 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fd1ee9c8-fde8-4456-9cf0-f7ebfd623186 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:03.306744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fd1ee9c8-fde8-4456-9cf0-f7ebfd623186 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:03.315889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd1ee9c8-fde8-4456-9cf0-f7ebfd623186 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:03.316491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd1ee9c8-fde8-4456-9cf0-f7ebfd623186 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:03.317441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd1ee9c8-fde8-4456-9cf0-f7ebfd623186 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:03.317979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd1ee9c8-fde8-4456-9cf0-f7ebfd623186 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:03.481037 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fd1ee9c8-fde8-4456-9cf0-f7ebfd623186 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.180151 May 28 14:25:03.484530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 207/379] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:03 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:03.534008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6f22b762-c85b-425b-a297-9d81a695fe56 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:03.543371 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6f22b762-c85b-425b-a297-9d81a695fe56 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.252824 May 28 14:25:03.544285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 173/380] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:03 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:03.777088 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-238f6bbb-2f4d-4262-9946-ee32a620b05e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:03.777775 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-238f6bbb-2f4d-4262-9946-ee32a620b05e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:03.786283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-238f6bbb-2f4d-4262-9946-ee32a620b05e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:03.786768 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-238f6bbb-2f4d-4262-9946-ee32a620b05e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:03.787613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-238f6bbb-2f4d-4262-9946-ee32a620b05e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:03.788095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-238f6bbb-2f4d-4262-9946-ee32a620b05e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:03.985789 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-238f6bbb-2f4d-4262-9946-ee32a620b05e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:03.995129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-238f6bbb-2f4d-4262-9946-ee32a620b05e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.222208 May 28 14:25:03.995715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 208/381] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:03 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:04.493548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9245d677-4a47-495a-a106-715d283f6dcd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:04.494503 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9245d677-4a47-495a-a106-715d283f6dcd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:04.502093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9245d677-4a47-495a-a106-715d283f6dcd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:04.502553 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9245d677-4a47-495a-a106-715d283f6dcd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:04.503380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9245d677-4a47-495a-a106-715d283f6dcd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:04.503861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9245d677-4a47-495a-a106-715d283f6dcd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:04.562170 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-01e8764d-49c9-49ae-97a2-dcc102df6617 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:04.563002 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-01e8764d-49c9-49ae-97a2-dcc102df6617 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:04.570349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01e8764d-49c9-49ae-97a2-dcc102df6617 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:04.570806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01e8764d-49c9-49ae-97a2-dcc102df6617 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:04.571648 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01e8764d-49c9-49ae-97a2-dcc102df6617 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:04.572102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01e8764d-49c9-49ae-97a2-dcc102df6617 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:04.872401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-01e8764d-49c9-49ae-97a2-dcc102df6617 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:04.885992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-01e8764d-49c9-49ae-97a2-dcc102df6617 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.328142 May 28 14:25:04.886740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 209/382] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:04 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:04.898160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9245d677-4a47-495a-a106-715d283f6dcd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.408616 May 28 14:25:04.899142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 174/383] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:04 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:05.012094 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-31410678-9518-46f2-aded-fc8a88a10714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:05.012716 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-31410678-9518-46f2-aded-fc8a88a10714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:05.025151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31410678-9518-46f2-aded-fc8a88a10714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:05.025151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31410678-9518-46f2-aded-fc8a88a10714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:05.025151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31410678-9518-46f2-aded-fc8a88a10714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:05.025151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31410678-9518-46f2-aded-fc8a88a10714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:05.232073 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-31410678-9518-46f2-aded-fc8a88a10714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:05.242037 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-31410678-9518-46f2-aded-fc8a88a10714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.233253 May 28 14:25:05.242612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 210/384] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:05 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:05.387929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1476473495", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "8023cc33-82ed-49b2-a8e8-69839a1ff66e"}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:05.466115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] validate_networks() for [('8023cc33-82ed-49b2-a8e8-69839a1ff66e', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:25:05.904090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:05.904839 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:05.913154 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:05.913642 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:05.914436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:05.914876 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:05.998090 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:25:05.998582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:25:05.999652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:25:06.000081 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:25:06.000510 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:25:06.013776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:06.015208 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:06.016261 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:06.016999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:06.039518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Getting quotas for project 1db248e02dac49bf8688658eb42ee752. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:25:06.045034 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Getting quotas for user 78113dc875a548d287a236802e0d6a0d and project 1db248e02dac49bf8688658eb42ee752. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:25:06.058107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:25:06.061449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:25:06.135517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:06.144084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1314 microversion: 2.1 time: 0.245267 May 28 14:25:06.144672 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 211/385] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:05 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:06.149301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-73112134-a760-4ebe-bd95-d8218663e277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:06.150227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-73112134-a760-4ebe-bd95-d8218663e277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:06.158259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-73112134-a760-4ebe-bd95-d8218663e277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:06.158752 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-73112134-a760-4ebe-bd95-d8218663e277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:06.159570 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-73112134-a760-4ebe-bd95-d8218663e277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:06.160182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-73112134-a760-4ebe-bd95-d8218663e277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:06.355397 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-73112134-a760-4ebe-bd95-d8218663e277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.209292 May 28 14:25:06.356057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 212/386] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:06 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:06.362152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-053ded33-cc33-48bf-a144-2d95f250e6ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:06.362893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-053ded33-cc33-48bf-a144-2d95f250e6ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:06.371246 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-053ded33-cc33-48bf-a144-2d95f250e6ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:06.371719 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-053ded33-cc33-48bf-a144-2d95f250e6ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:06.372536 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-053ded33-cc33-48bf-a144-2d95f250e6ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:06.372948 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-053ded33-cc33-48bf-a144-2d95f250e6ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:06.393154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4da07a4a-7927-4673-9043-fa2eb1c22a63 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009133 May 28 14:25:06.399142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 175/387] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:25:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:25:06.404581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2b403538-ef83-4c3d-878f-faa229d4947e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:06.406043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2b403538-ef83-4c3d-878f-faa229d4947e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:06.497144 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2b403538-ef83-4c3d-878f-faa229d4947e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:06.507618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2b403538-ef83-4c3d-878f-faa229d4947e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1219 microversion: 2.1 time: 0.106898 May 28 14:25:06.518176 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 176/388] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:06 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:06.635742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-053ded33-cc33-48bf-a144-2d95f250e6ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:06.647378 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-053ded33-cc33-48bf-a144-2d95f250e6ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1567 microversion: 2.1 time: 0.289942 May 28 14:25:06.647998 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 213/389] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:06 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:07.162118 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:07.162763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:07.173335 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:07.173524 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:07.174818 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:07.176117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:07.368717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2bd2b9d7-967d-4e92-9823-614c6ce269e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:07.374650 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2bd2b9d7-967d-4e92-9823-614c6ce269e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:07.380258 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2bd2b9d7-967d-4e92-9823-614c6ce269e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:07.380733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2bd2b9d7-967d-4e92-9823-614c6ce269e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:07.381600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2bd2b9d7-967d-4e92-9823-614c6ce269e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:07.382027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2bd2b9d7-967d-4e92-9823-614c6ce269e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:07.434076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:07.458012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1497 microversion: 2.1 time: 0.299964 May 28 14:25:07.460594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 177/390] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:07 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1497 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:07.508881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2bd2b9d7-967d-4e92-9823-614c6ce269e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.144139 May 28 14:25:07.509539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 214/391] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:07 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:07.526470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fe52c6f9-0844-40dd-b754-a4fec0fb4775 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:07.527338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fe52c6f9-0844-40dd-b754-a4fec0fb4775 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:07.610853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-fe52c6f9-0844-40dd-b754-a4fec0fb4775 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:07.617339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fe52c6f9-0844-40dd-b754-a4fec0fb4775 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1219 microversion: 2.1 time: 0.095579 May 28 14:25:07.618183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 178/392] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:07 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:07.669223 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a50880eb-c052-46a9-9265-322535a04070 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:07.669929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a50880eb-c052-46a9-9265-322535a04070 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:07.686961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a50880eb-c052-46a9-9265-322535a04070 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:07.686961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a50880eb-c052-46a9-9265-322535a04070 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:07.686961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a50880eb-c052-46a9-9265-322535a04070 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:07.686961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a50880eb-c052-46a9-9265-322535a04070 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:07.897184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a50880eb-c052-46a9-9265-322535a04070 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:07.907242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a50880eb-c052-46a9-9265-322535a04070 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1547 microversion: 2.1 time: 0.244500 May 28 14:25:07.907881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 215/393] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:07 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1547 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:07.924311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:07.924957 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:07.935032 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:07.935477 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:07.938183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:07.938183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:08.386985 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] HTTP exception thrown: Cannot 'detach_volume' instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f while it is in vm_state rescued May 28 14:25:08.387704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Returning 409 to user: Cannot 'detach_volume' instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f while it is in vm_state rescued {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:25:08.388521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-02d65f47-3652-43cd-b2f4-23507a098ea9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/os-volume_attachments/cf887260-79ad-47a1-9ae3-a0828186db30" status: 409 len: 152 microversion: 2.1 time: 0.468894 May 28 14:25:08.389098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 179/394] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:25:07 2021] DELETE /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/os-volume_attachments/cf887260-79ad-47a1-9ae3-a0828186db30 => generated 152 bytes in 470 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 14:25:08.398384 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:08.399973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:08.411829 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:08.412516 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:08.413494 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:08.414135 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:08.521277 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7ac66d79-ac6c-4b98-b322-2d295743d584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:08.522582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7ac66d79-ac6c-4b98-b322-2d295743d584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:08.536351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ac66d79-ac6c-4b98-b322-2d295743d584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:08.537315 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ac66d79-ac6c-4b98-b322-2d295743d584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:08.538338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ac66d79-ac6c-4b98-b322-2d295743d584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:08.539142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ac66d79-ac6c-4b98-b322-2d295743d584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:08.655772 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7ac66d79-ac6c-4b98-b322-2d295743d584 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.137496 May 28 14:25:08.660003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 180/395] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:08 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:08.662550 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-304e7444-7ea5-49a8-a2c2-45b64257feeb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:08.663333 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-304e7444-7ea5-49a8-a2c2-45b64257feeb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:08.672783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-304e7444-7ea5-49a8-a2c2-45b64257feeb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:08.673243 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-304e7444-7ea5-49a8-a2c2-45b64257feeb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:08.674110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-304e7444-7ea5-49a8-a2c2-45b64257feeb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:08.674631 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-304e7444-7ea5-49a8-a2c2-45b64257feeb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:08.794270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-304e7444-7ea5-49a8-a2c2-45b64257feeb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:08.803399 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-304e7444-7ea5-49a8-a2c2-45b64257feeb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1223 microversion: 2.1 time: 0.145681 May 28 14:25:08.812765 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 181/396] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:08 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1223 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:08.854931 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action" status: 202 len: 0 microversion: 2.1 time: 0.459868 May 28 14:25:08.855588 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 216/397] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:25:08 2021] POST /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:08.863893 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:08.865344 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:08.873199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:08.873666 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:08.874573 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:08.875070 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:09.196574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:09.210813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1555 microversion: 2.1 time: 0.350848 May 28 14:25:09.211705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 182/398] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:08 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1555 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:09.493848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5cd69399-4a70-40e8-af47-62e96d509c42 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:09.494521 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5cd69399-4a70-40e8-af47-62e96d509c42 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:09.502576 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5cd69399-4a70-40e8-af47-62e96d509c42 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:09.503163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5cd69399-4a70-40e8-af47-62e96d509c42 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:09.504080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5cd69399-4a70-40e8-af47-62e96d509c42 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:09.504602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5cd69399-4a70-40e8-af47-62e96d509c42 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:09.567987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5cd69399-4a70-40e8-af47-62e96d509c42 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:25:09.669713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-47efef47-8c53-4cb8-a2c6-540b1e8e65d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:09.671168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-47efef47-8c53-4cb8-a2c6-540b1e8e65d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:09.681098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47efef47-8c53-4cb8-a2c6-540b1e8e65d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:09.681905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47efef47-8c53-4cb8-a2c6-540b1e8e65d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:09.683842 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47efef47-8c53-4cb8-a2c6-540b1e8e65d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:09.684751 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47efef47-8c53-4cb8-a2c6-540b1e8e65d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:09.834565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-47efef47-8c53-4cb8-a2c6-540b1e8e65d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.170264 May 28 14:25:09.835222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 183/399] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:09 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:09.840931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-99a89f90-e559-41ee-929e-7f869b0ab4ec tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:09.841649 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-99a89f90-e559-41ee-929e-7f869b0ab4ec tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:09.851223 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-99a89f90-e559-41ee-929e-7f869b0ab4ec tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:09.851711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-99a89f90-e559-41ee-929e-7f869b0ab4ec tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:09.852695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-99a89f90-e559-41ee-929e-7f869b0ab4ec tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:09.853135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-99a89f90-e559-41ee-929e-7f869b0ab4ec tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:10.040713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-99a89f90-e559-41ee-929e-7f869b0ab4ec tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:10.049319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-99a89f90-e559-41ee-929e-7f869b0ab4ec tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1271 microversion: 2.1 time: 0.212471 May 28 14:25:10.049907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 184/400] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:09 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:10.073939 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5cd69399-4a70-40e8-af47-62e96d509c42 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 204 len: 0 microversion: 2.1 time: 0.584399 May 28 14:25:10.078990 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 217/401] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:25:09 2021] DELETE /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:25:10.083947 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-608ae2ae-3364-4a52-9869-66844582551f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:10.084574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-608ae2ae-3364-4a52-9869-66844582551f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:10.094759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-608ae2ae-3364-4a52-9869-66844582551f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:10.095173 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-608ae2ae-3364-4a52-9869-66844582551f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:10.096079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-608ae2ae-3364-4a52-9869-66844582551f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:10.096562 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-608ae2ae-3364-4a52-9869-66844582551f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:10.229420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:10.230404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:10.238666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:10.239272 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:10.240099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:10.240575 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:10.465028 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-608ae2ae-3364-4a52-9869-66844582551f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:10.477168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-608ae2ae-3364-4a52-9869-66844582551f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1503 microversion: 2.1 time: 0.396794 May 28 14:25:10.488948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 185/402] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:10 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1503 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:10.699957 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:10.710455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1555 microversion: 2.1 time: 0.485634 May 28 14:25:10.727914 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 218/403] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:10 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1555 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:10.847016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cce2630a-7d95-40df-a184-2e76a4563a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:10.849011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cce2630a-7d95-40df-a184-2e76a4563a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:10.865601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cce2630a-7d95-40df-a184-2e76a4563a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:10.866463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cce2630a-7d95-40df-a184-2e76a4563a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:10.867768 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cce2630a-7d95-40df-a184-2e76a4563a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:10.868378 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cce2630a-7d95-40df-a184-2e76a4563a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:11.059520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cce2630a-7d95-40df-a184-2e76a4563a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.216714 May 28 14:25:11.065660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 186/404] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:10 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:11.069702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e4856db7-7c40-4450-8662-8a3354296657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:11.070806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e4856db7-7c40-4450-8662-8a3354296657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:11.079103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e4856db7-7c40-4450-8662-8a3354296657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:11.080131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e4856db7-7c40-4450-8662-8a3354296657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:11.086278 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e4856db7-7c40-4450-8662-8a3354296657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:11.089698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e4856db7-7c40-4450-8662-8a3354296657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:11.216216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e4856db7-7c40-4450-8662-8a3354296657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:11.231152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e4856db7-7c40-4450-8662-8a3354296657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1277 microversion: 2.1 time: 0.165195 May 28 14:25:11.232561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 219/405] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:11 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:11.498844 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-62cbb353-4dfc-45cf-a030-3cfa980f762b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:11.503801 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-62cbb353-4dfc-45cf-a030-3cfa980f762b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:11.518922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-62cbb353-4dfc-45cf-a030-3cfa980f762b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:11.519585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-62cbb353-4dfc-45cf-a030-3cfa980f762b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:11.520506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-62cbb353-4dfc-45cf-a030-3cfa980f762b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:11.521083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-62cbb353-4dfc-45cf-a030-3cfa980f762b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:11.749972 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4e081de4-ab04-4a24-a111-d0e5763c8f64 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:11.751014 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4e081de4-ab04-4a24-a111-d0e5763c8f64 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:11.764941 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e081de4-ab04-4a24-a111-d0e5763c8f64 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:11.766624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e081de4-ab04-4a24-a111-d0e5763c8f64 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:11.766813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e081de4-ab04-4a24-a111-d0e5763c8f64 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:11.767508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e081de4-ab04-4a24-a111-d0e5763c8f64 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:12.038509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-62cbb353-4dfc-45cf-a030-3cfa980f762b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:12.047257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-62cbb353-4dfc-45cf-a030-3cfa980f762b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1503 microversion: 2.1 time: 0.553476 May 28 14:25:12.048336 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 187/406] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:11 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1503 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:12.072508 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-edd3480b-4caf-4803-bc51-8cc4b997377c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:12.073475 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-edd3480b-4caf-4803-bc51-8cc4b997377c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:12.081986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-edd3480b-4caf-4803-bc51-8cc4b997377c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:12.082770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-edd3480b-4caf-4803-bc51-8cc4b997377c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:12.083389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-edd3480b-4caf-4803-bc51-8cc4b997377c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:12.083988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-edd3480b-4caf-4803-bc51-8cc4b997377c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:12.208837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-edd3480b-4caf-4803-bc51-8cc4b997377c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.140055 May 28 14:25:12.209582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 188/407] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:12 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:12.245644 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4e081de4-ab04-4a24-a111-d0e5763c8f64 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:12.254518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:12.256549 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4e081de4-ab04-4a24-a111-d0e5763c8f64 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1555 microversion: 2.1 time: 0.511741 May 28 14:25:12.257732 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 220/408] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:11 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1555 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:12.271983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:12.282130 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:12.282824 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:12.284017 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:12.284652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:12.819072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:12.829492 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.583527 May 28 14:25:12.839222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 189/409] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:12 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:13.067727 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a242cfe2-964f-4063-9cc4-89564328200c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:13.069600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a242cfe2-964f-4063-9cc4-89564328200c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:13.082267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a242cfe2-964f-4063-9cc4-89564328200c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:13.083529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a242cfe2-964f-4063-9cc4-89564328200c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:13.085379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a242cfe2-964f-4063-9cc4-89564328200c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:13.086109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a242cfe2-964f-4063-9cc4-89564328200c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:13.221026 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3788deca-13ef-43ad-aade-20a51f105b6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:13.222069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3788deca-13ef-43ad-aade-20a51f105b6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:13.230011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3788deca-13ef-43ad-aade-20a51f105b6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:13.230471 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3788deca-13ef-43ad-aade-20a51f105b6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:13.231473 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3788deca-13ef-43ad-aade-20a51f105b6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:13.231954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3788deca-13ef-43ad-aade-20a51f105b6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:13.378582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3788deca-13ef-43ad-aade-20a51f105b6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.161830 May 28 14:25:13.379999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 190/410] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:13 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:13.386498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:13.387633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:13.396837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:13.397295 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:13.398144 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:13.398588 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:13.707853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:13.719218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1555 microversion: 2.1 time: 0.337179 May 28 14:25:13.719849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 191/411] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:13 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1555 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:13.830875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a242cfe2-964f-4063-9cc4-89564328200c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:13.850244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:13.853480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:13.882355 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a242cfe2-964f-4063-9cc4-89564328200c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1503 microversion: 2.1 time: 0.813663 May 28 14:25:13.884870 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 221/412] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:13 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1503 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:13.885177 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:13.885655 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:13.886559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:13.887008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:14.393337 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e051ec99-d9db-4878-9376-5efff92cf8f9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:14.397102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e051ec99-d9db-4878-9376-5efff92cf8f9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:14.413388 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:14.427974 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e051ec99-d9db-4878-9376-5efff92cf8f9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:14.428488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e051ec99-d9db-4878-9376-5efff92cf8f9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:14.438552 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e051ec99-d9db-4878-9376-5efff92cf8f9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:14.438552 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e051ec99-d9db-4878-9376-5efff92cf8f9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:14.447939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.602594 May 28 14:25:14.453571 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 192/413] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:13 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:14.613889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e051ec99-d9db-4878-9376-5efff92cf8f9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.226375 May 28 14:25:14.614587 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 222/414] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:14 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:14.709527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-6b7c3d8e-0069-41ea-ad1e-19252e6e1a64 req-c3abf49b-fd7e-4ec2-b32a-21103354c193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a422bf7-82c2-409e-a573-929842d0cff3", "name": "network-vif-deleted", "tag": "3c609de4-4752-48b6-81cf-9335e2a7a542"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:14.711178 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:25:14.711178 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:25:14.726150 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-6b7c3d8e-0069-41ea-ad1e-19252e6e1a64 req-c3abf49b-fd7e-4ec2-b32a-21103354c193 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:14.726909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-6b7c3d8e-0069-41ea-ad1e-19252e6e1a64 req-c3abf49b-fd7e-4ec2-b32a-21103354c193 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:14.746484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8466ac77-da98-44d4-9a5b-1af347de1ec2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:14.747832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8466ac77-da98-44d4-9a5b-1af347de1ec2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:14.763598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-6b7c3d8e-0069-41ea-ad1e-19252e6e1a64 req-c3abf49b-fd7e-4ec2-b32a-21103354c193 service nova] Creating event network-vif-deleted:3c609de4-4752-48b6-81cf-9335e2a7a542 for instance 3a422bf7-82c2-409e-a573-929842d0cff3 on hv-cinder-79128 May 28 14:25:14.769749 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-6b7c3d8e-0069-41ea-ad1e-19252e6e1a64 req-c3abf49b-fd7e-4ec2-b32a-21103354c193 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070314 May 28 14:25:14.773420 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 193/415] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:25:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:25:14.777650 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8466ac77-da98-44d4-9a5b-1af347de1ec2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:14.778561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8466ac77-da98-44d4-9a5b-1af347de1ec2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:14.779660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8466ac77-da98-44d4-9a5b-1af347de1ec2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:14.780375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8466ac77-da98-44d4-9a5b-1af347de1ec2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:14.902034 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:14.903776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:14.914485 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:14.915222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:14.916301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:14.916981 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:15.292266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:15.304105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 200 len: 1299 microversion: 2.1 time: 0.406300 May 28 14:25:15.309408 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 194/416] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:14 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 1299 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:15.471908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6987ef37-c849-47f0-930c-82bc7b344832 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:15.472538 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8466ac77-da98-44d4-9a5b-1af347de1ec2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:15.474820 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6987ef37-c849-47f0-930c-82bc7b344832 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:15.481221 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8466ac77-da98-44d4-9a5b-1af347de1ec2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1561 microversion: 2.1 time: 0.746245 May 28 14:25:15.485966 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6987ef37-c849-47f0-930c-82bc7b344832 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:15.486636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6987ef37-c849-47f0-930c-82bc7b344832 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:15.487665 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6987ef37-c849-47f0-930c-82bc7b344832 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:15.488525 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6987ef37-c849-47f0-930c-82bc7b344832 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:15.492235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 223/417] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:14 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1561 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:15.634744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5214eac7-83b8-4b72-bf66-7834669f714b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:15.637307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5214eac7-83b8-4b72-bf66-7834669f714b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:15.664212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5214eac7-83b8-4b72-bf66-7834669f714b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:15.671244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5214eac7-83b8-4b72-bf66-7834669f714b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:15.671244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5214eac7-83b8-4b72-bf66-7834669f714b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:15.671244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5214eac7-83b8-4b72-bf66-7834669f714b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:15.784483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5214eac7-83b8-4b72-bf66-7834669f714b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.153179 May 28 14:25:15.785286 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 224/418] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:15 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:15.794783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-15f0d4bc-9dea-4290-9c91-74450a42c2de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:15.796542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-15f0d4bc-9dea-4290-9c91-74450a42c2de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:15.811740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-15f0d4bc-9dea-4290-9c91-74450a42c2de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:15.812210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-15f0d4bc-9dea-4290-9c91-74450a42c2de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:15.817314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-15f0d4bc-9dea-4290-9c91-74450a42c2de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:15.817791 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-15f0d4bc-9dea-4290-9c91-74450a42c2de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:16.020168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6987ef37-c849-47f0-930c-82bc7b344832 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:16.028834 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6987ef37-c849-47f0-930c-82bc7b344832 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.562919 May 28 14:25:16.031501 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 195/419] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:15 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:16.102173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-15f0d4bc-9dea-4290-9c91-74450a42c2de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lazy-loading 'services' on Instance uuid 9c17d712-c03d-44ac-bd8d-5f9b99160b0f {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:25:16.321643 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:16.322703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 3a422bf7-82c2-409e-a573-929842d0cff3] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:16.333534 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:16.335827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:16.336857 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:16.337315 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:16.406763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] HTTP exception thrown: Instance 3a422bf7-82c2-409e-a573-929842d0cff3 could not be found. May 28 14:25:16.407422 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Returning 404 to user: Instance 3a422bf7-82c2-409e-a573-929842d0cff3 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:25:16.408304 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a1cc1507-70aa-4cd3-8d6b-5e2d041ade49 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3" status: 404 len: 111 microversion: 2.1 time: 0.091048 May 28 14:25:16.408886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 196/420] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:16 2021] GET /compute/v2.1/servers/3a422bf7-82c2-409e-a573-929842d0cff3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:25:16.673252 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-472236629", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "0d994a91-584d-47dc-9f6d-eb7159fb0da8"}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:16.750498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] validate_networks() for [('0d994a91-584d-47dc-9f6d-eb7159fb0da8', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:25:16.796244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-15f0d4bc-9dea-4290-9c91-74450a42c2de tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/os-volume_attachments/cf887260-79ad-47a1-9ae3-a0828186db30" status: 202 len: 0 microversion: 2.1 time: 0.981194 May 28 14:25:16.796244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 225/421] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:25:15 2021] DELETE /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f/os-volume_attachments/cf887260-79ad-47a1-9ae3-a0828186db30 => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:16.803520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-219e1841-ef13-4571-80bf-334fe897628e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:16.806138 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-219e1841-ef13-4571-80bf-334fe897628e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:16.818909 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-219e1841-ef13-4571-80bf-334fe897628e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:16.819745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-219e1841-ef13-4571-80bf-334fe897628e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:16.820717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-219e1841-ef13-4571-80bf-334fe897628e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:16.821495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-219e1841-ef13-4571-80bf-334fe897628e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:17.038566 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-219e1841-ef13-4571-80bf-334fe897628e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.241523 May 28 14:25:17.039683 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 226/422] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:16 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:17.045112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-b4dbcb63-07f8-410e-8ee9-2aaa3f2b67d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031d9ce3-9559-48b6-b92f-47ac210b74be", "tag": "15e73ba1-bc57-49ac-bae9-9906c3fe9522"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:17.048402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:25:17.048402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:25:17.066031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-b4dbcb63-07f8-410e-8ee9-2aaa3f2b67d5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:17.066484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-b4dbcb63-07f8-410e-8ee9-2aaa3f2b67d5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:17.126011 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-b4dbcb63-07f8-410e-8ee9-2aaa3f2b67d5 service nova] Creating event network-changed:15e73ba1-bc57-49ac-bae9-9906c3fe9522 for instance 031d9ce3-9559-48b6-b92f-47ac210b74be on hv-cinder-79128 May 28 14:25:17.132046 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-b4dbcb63-07f8-410e-8ee9-2aaa3f2b67d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090699 May 28 14:25:17.136384 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 227/423] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:25:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:25:17.142379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-27e32e0d-5554-4df6-a426-90a15a2d6157 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:17.143761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-27e32e0d-5554-4df6-a426-90a15a2d6157 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:17.152676 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27e32e0d-5554-4df6-a426-90a15a2d6157 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:17.153757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27e32e0d-5554-4df6-a426-90a15a2d6157 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:17.154750 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27e32e0d-5554-4df6-a426-90a15a2d6157 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:17.155361 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27e32e0d-5554-4df6-a426-90a15a2d6157 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:17.900139 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:25:17.900708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:25:17.901050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:25:17.901466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:25:17.901888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:25:17.916092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:17.916275 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:17.917093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:17.917498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:17.962061 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Getting quotas for project eba85ed1a1a14a848b3f33435440dff1. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:25:17.969294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Getting quotas for user abfb66238fe64034b35f81b0f7e76fc2 and project eba85ed1a1a14a848b3f33435440dff1. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:25:17.987237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:25:17.990321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:25:18.172117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-27e32e0d-5554-4df6-a426-90a15a2d6157 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:18.182668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-27e32e0d-5554-4df6-a426-90a15a2d6157 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 1.044765 May 28 14:25:18.183858 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 228/424] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:17 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:18.193248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-02430e7b-5ad8-43e8-b348-b761daae6047 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:18.195396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-02430e7b-5ad8-43e8-b348-b761daae6047 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:18.197915 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4f3d4410-5afd-47d2-a77e-95429f889548 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531999 May 28 14:25:18.203309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02430e7b-5ad8-43e8-b348-b761daae6047 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:18.203715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02430e7b-5ad8-43e8-b348-b761daae6047 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:18.204525 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02430e7b-5ad8-43e8-b348-b761daae6047 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:18.205019 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02430e7b-5ad8-43e8-b348-b761daae6047 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:18.207183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 197/425] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:25:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 14:25:18.218620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2b667c45-078f-4069-9695-ebb1ebbb8aba tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:18.219457 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2b667c45-078f-4069-9695-ebb1ebbb8aba tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:18.342730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2b667c45-078f-4069-9695-ebb1ebbb8aba tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:18.352269 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2b667c45-078f-4069-9695-ebb1ebbb8aba tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1213 microversion: 2.1 time: 0.138395 May 28 14:25:18.353092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 198/426] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:18 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:18.356404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-02430e7b-5ad8-43e8-b348-b761daae6047 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.170891 May 28 14:25:18.357076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 229/427] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:18 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:19.200713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:19.201330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:19.220332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:19.220789 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:19.221582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:19.222027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:19.372264 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5f26aae2-0a4d-43d4-ad34-3065040b8725 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:19.374257 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5f26aae2-0a4d-43d4-ad34-3065040b8725 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:19.387075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5f26aae2-0a4d-43d4-ad34-3065040b8725 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:19.387545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5f26aae2-0a4d-43d4-ad34-3065040b8725 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:19.388368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5f26aae2-0a4d-43d4-ad34-3065040b8725 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:19.388835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5f26aae2-0a4d-43d4-ad34-3065040b8725 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:19.544879 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:19.554593 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.357578 May 28 14:25:19.555181 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 199/428] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:19 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:19.560100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-67e269d8-74e7-4fb5-8fa9-19d8deeecac4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:19.561799 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-67e269d8-74e7-4fb5-8fa9-19d8deeecac4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:19.570394 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-67e269d8-74e7-4fb5-8fa9-19d8deeecac4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:19.570998 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-67e269d8-74e7-4fb5-8fa9-19d8deeecac4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:19.573206 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-67e269d8-74e7-4fb5-8fa9-19d8deeecac4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:19.573713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-67e269d8-74e7-4fb5-8fa9-19d8deeecac4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:19.630468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5f26aae2-0a4d-43d4-ad34-3065040b8725 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:19.648292 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5f26aae2-0a4d-43d4-ad34-3065040b8725 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1217 microversion: 2.1 time: 0.280029 May 28 14:25:19.649145 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 230/429] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:19 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:19.703172 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-67e269d8-74e7-4fb5-8fa9-19d8deeecac4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.146294 May 28 14:25:19.704393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 200/430] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:19 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:20.573215 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:20.573718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:20.582290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:20.582755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:20.583910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:20.584660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:20.667217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-aee355b6-36bd-4d84-9980-b3612f6fe751 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:20.668557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-aee355b6-36bd-4d84-9980-b3612f6fe751 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:20.678094 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aee355b6-36bd-4d84-9980-b3612f6fe751 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:20.678556 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aee355b6-36bd-4d84-9980-b3612f6fe751 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:20.679544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aee355b6-36bd-4d84-9980-b3612f6fe751 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:20.679968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aee355b6-36bd-4d84-9980-b3612f6fe751 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:20.970146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-aee355b6-36bd-4d84-9980-b3612f6fe751 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:20.980332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-aee355b6-36bd-4d84-9980-b3612f6fe751 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1265 microversion: 2.1 time: 0.317975 May 28 14:25:20.991767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 201/431] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:20 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:20.997475 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-562c3ea6-feb5-4bd0-9edd-1e023f51b098 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:20.999675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-562c3ea6-feb5-4bd0-9edd-1e023f51b098 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:21.008457 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-562c3ea6-feb5-4bd0-9edd-1e023f51b098 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:21.008932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-562c3ea6-feb5-4bd0-9edd-1e023f51b098 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:21.009740 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-562c3ea6-feb5-4bd0-9edd-1e023f51b098 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:21.010192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-562c3ea6-feb5-4bd0-9edd-1e023f51b098 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:21.099427 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:21.109079 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.540332 May 28 14:25:21.109654 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 231/432] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:20 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:21.173826 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-562c3ea6-feb5-4bd0-9edd-1e023f51b098 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.180250 May 28 14:25:21.176308 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 202/433] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:20 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:21.999436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-601e7411-6eb7-46ac-8df5-1f711cc53427 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:22.000190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-601e7411-6eb7-46ac-8df5-1f711cc53427 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:22.008216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-601e7411-6eb7-46ac-8df5-1f711cc53427 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:22.008670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-601e7411-6eb7-46ac-8df5-1f711cc53427 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:22.009669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-601e7411-6eb7-46ac-8df5-1f711cc53427 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:22.010101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-601e7411-6eb7-46ac-8df5-1f711cc53427 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:22.127069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0a5fb1df-99ee-405d-9c43-da88cc1df14e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:22.127864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0a5fb1df-99ee-405d-9c43-da88cc1df14e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:22.137323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a5fb1df-99ee-405d-9c43-da88cc1df14e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:22.137819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a5fb1df-99ee-405d-9c43-da88cc1df14e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:22.138622 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a5fb1df-99ee-405d-9c43-da88cc1df14e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:22.139117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a5fb1df-99ee-405d-9c43-da88cc1df14e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:22.199469 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-601e7411-6eb7-46ac-8df5-1f711cc53427 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:22.211479 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-601e7411-6eb7-46ac-8df5-1f711cc53427 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1271 microversion: 2.1 time: 0.216319 May 28 14:25:22.223592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 232/434] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:21 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:22.223592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-094ceddb-abc2-45f3-9531-0ba40a6c60dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:22.231007 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-094ceddb-abc2-45f3-9531-0ba40a6c60dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:22.261776 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-094ceddb-abc2-45f3-9531-0ba40a6c60dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:22.264497 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-094ceddb-abc2-45f3-9531-0ba40a6c60dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:22.265505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-094ceddb-abc2-45f3-9531-0ba40a6c60dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:22.267226 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-094ceddb-abc2-45f3-9531-0ba40a6c60dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:22.417528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0a5fb1df-99ee-405d-9c43-da88cc1df14e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:22.426862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0a5fb1df-99ee-405d-9c43-da88cc1df14e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.304086 May 28 14:25:22.428151 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 203/435] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:22 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:23.230484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-14755890-1df2-4e28-bef2-43d6e48c2ff3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:23.231220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-14755890-1df2-4e28-bef2-43d6e48c2ff3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:23.239986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-14755890-1df2-4e28-bef2-43d6e48c2ff3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:23.240452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-14755890-1df2-4e28-bef2-43d6e48c2ff3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:23.241258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-14755890-1df2-4e28-bef2-43d6e48c2ff3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:23.241707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-14755890-1df2-4e28-bef2-43d6e48c2ff3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:23.456370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-14755890-1df2-4e28-bef2-43d6e48c2ff3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:23.466472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-14755890-1df2-4e28-bef2-43d6e48c2ff3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.238737 May 28 14:25:23.476664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 204/436] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:23 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:23.481634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8e06b5c4-1165-4e83-a9dd-411b2887d57b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:23.482265 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8e06b5c4-1165-4e83-a9dd-411b2887d57b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:23.489671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8e06b5c4-1165-4e83-a9dd-411b2887d57b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:23.490141 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8e06b5c4-1165-4e83-a9dd-411b2887d57b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:23.490944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8e06b5c4-1165-4e83-a9dd-411b2887d57b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:23.491391 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8e06b5c4-1165-4e83-a9dd-411b2887d57b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:23.693760 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8e06b5c4-1165-4e83-a9dd-411b2887d57b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:23.705889 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8e06b5c4-1165-4e83-a9dd-411b2887d57b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.227729 May 28 14:25:23.717531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 205/437] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:23 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:24.191315 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-a4e23312-777a-42be-84cd-8f8591ef8d2b req-5e576df1-39ab-4884-8c39-d38e6b05aa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031d9ce3-9559-48b6-b92f-47ac210b74be", "name": "network-vif-plugged", "status": "completed", "tag": "15e73ba1-bc57-49ac-bae9-9906c3fe9522"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:24.193287 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:25:24.193287 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:25:24.204613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-a4e23312-777a-42be-84cd-8f8591ef8d2b req-5e576df1-39ab-4884-8c39-d38e6b05aa19 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:24.205279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-a4e23312-777a-42be-84cd-8f8591ef8d2b req-5e576df1-39ab-4884-8c39-d38e6b05aa19 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:24.222714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-a4e23312-777a-42be-84cd-8f8591ef8d2b req-5e576df1-39ab-4884-8c39-d38e6b05aa19 service nova] Creating event network-vif-plugged:15e73ba1-bc57-49ac-bae9-9906c3fe9522 for instance 031d9ce3-9559-48b6-b92f-47ac210b74be on hv-cinder-79128 May 28 14:25:24.228051 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-a4e23312-777a-42be-84cd-8f8591ef8d2b req-5e576df1-39ab-4884-8c39-d38e6b05aa19 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041944 May 28 14:25:24.228828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 206/438] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:25:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:25:24.486531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:24.488953 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:24.499074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:24.504808 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:24.504808 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:24.504808 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:24.751816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:24.762928 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.282867 May 28 14:25:24.763606 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 207/439] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:24 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:24.771812 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-287a8d32-5d9b-4bcf-9065-325216a467f9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:24.771812 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-287a8d32-5d9b-4bcf-9065-325216a467f9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:24.790012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-287a8d32-5d9b-4bcf-9065-325216a467f9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:24.792127 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-287a8d32-5d9b-4bcf-9065-325216a467f9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:24.793406 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-287a8d32-5d9b-4bcf-9065-325216a467f9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:24.794317 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-287a8d32-5d9b-4bcf-9065-325216a467f9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:25.071870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-287a8d32-5d9b-4bcf-9065-325216a467f9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:25.081526 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-287a8d32-5d9b-4bcf-9065-325216a467f9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.316364 May 28 14:25:25.082687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 208/440] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:24 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:25.781560 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-074b86f1-d462-4f92-8566-ada660dc9cf1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:25.782326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-074b86f1-d462-4f92-8566-ada660dc9cf1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:25.792098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-074b86f1-d462-4f92-8566-ada660dc9cf1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:25.792704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-074b86f1-d462-4f92-8566-ada660dc9cf1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:25.793695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-074b86f1-d462-4f92-8566-ada660dc9cf1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:25.794198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-074b86f1-d462-4f92-8566-ada660dc9cf1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:25.970749 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-094ceddb-abc2-45f3-9531-0ba40a6c60dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 3.753191 May 28 14:25:25.975986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 233/441] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:22 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 3759 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:26.033739 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-074b86f1-d462-4f92-8566-ada660dc9cf1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:26.042762 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-074b86f1-d462-4f92-8566-ada660dc9cf1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.265962 May 28 14:25:26.043447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 209/442] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:25 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:26.099253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b28ea0e2-8df0-4596-b4af-1cd736d24484 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:26.099992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b28ea0e2-8df0-4596-b4af-1cd736d24484 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:26.123229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b28ea0e2-8df0-4596-b4af-1cd736d24484 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:26.123726 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b28ea0e2-8df0-4596-b4af-1cd736d24484 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:26.124717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b28ea0e2-8df0-4596-b4af-1cd736d24484 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:26.125633 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b28ea0e2-8df0-4596-b4af-1cd736d24484 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:26.676747 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b28ea0e2-8df0-4596-b4af-1cd736d24484 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:26.685208 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b28ea0e2-8df0-4596-b4af-1cd736d24484 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.590033 May 28 14:25:26.686377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 234/443] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:26 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:26.983856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0161350c-f9a8-4554-88fb-8a8c8509e414 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:26.984795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0161350c-f9a8-4554-88fb-8a8c8509e414 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:26.992446 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0161350c-f9a8-4554-88fb-8a8c8509e414 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:26.993149 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0161350c-f9a8-4554-88fb-8a8c8509e414 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:26.993937 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0161350c-f9a8-4554-88fb-8a8c8509e414 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:26.994375 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0161350c-f9a8-4554-88fb-8a8c8509e414 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:27.062957 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-13fada5b-fb92-41d4-a19c-149775f3f9c3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:27.064422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-13fada5b-fb92-41d4-a19c-149775f3f9c3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:27.072866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-13fada5b-fb92-41d4-a19c-149775f3f9c3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:27.078182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-13fada5b-fb92-41d4-a19c-149775f3f9c3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:27.078182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-13fada5b-fb92-41d4-a19c-149775f3f9c3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:27.078182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-13fada5b-fb92-41d4-a19c-149775f3f9c3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:27.208781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0161350c-f9a8-4554-88fb-8a8c8509e414 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.229153 May 28 14:25:27.213513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 210/444] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:26 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:27.706443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d67bdd3a-a98d-459c-a028-0d825c6511c3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:27.708831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d67bdd3a-a98d-459c-a028-0d825c6511c3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:27.722791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d67bdd3a-a98d-459c-a028-0d825c6511c3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:27.723250 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d67bdd3a-a98d-459c-a028-0d825c6511c3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:27.726219 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d67bdd3a-a98d-459c-a028-0d825c6511c3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:27.726935 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d67bdd3a-a98d-459c-a028-0d825c6511c3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:27.989120 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d67bdd3a-a98d-459c-a028-0d825c6511c3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:27.998248 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d67bdd3a-a98d-459c-a028-0d825c6511c3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1319 microversion: 2.1 time: 0.299123 May 28 14:25:27.999062 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 211/445] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:27 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:28.178064 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-13fada5b-fb92-41d4-a19c-149775f3f9c3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:28.187295 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-13fada5b-fb92-41d4-a19c-149775f3f9c3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 1.129566 May 28 14:25:28.187924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 235/446] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:27 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:28.221613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ae7ba510-1ace-4e67-9869-2184ef0b829c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:28.222968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ae7ba510-1ace-4e67-9869-2184ef0b829c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:28.230624 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae7ba510-1ace-4e67-9869-2184ef0b829c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:28.231322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae7ba510-1ace-4e67-9869-2184ef0b829c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:28.232148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae7ba510-1ace-4e67-9869-2184ef0b829c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:28.233426 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae7ba510-1ace-4e67-9869-2184ef0b829c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:28.352715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:28.353352 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:28.370331 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:28.372809 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:28.373914 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:28.374691 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:28.447872 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ae7ba510-1ace-4e67-9869-2184ef0b829c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.230521 May 28 14:25:28.449427 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 212/447] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:28 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:28.456135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-70ce9560-479b-4e03-8f67-be33802fc01c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27eed777-874a-4f63-898a-6d4f77aef89d", "tag": "5e55d283-7678-4380-b5d1-eda7730dd76b"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:28.458258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:25:28.458258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:25:28.465939 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:25:28.469996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-70ce9560-479b-4e03-8f67-be33802fc01c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:28.470613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-70ce9560-479b-4e03-8f67-be33802fc01c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:28.490431 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-70ce9560-479b-4e03-8f67-be33802fc01c service nova] Creating event network-changed:5e55d283-7678-4380-b5d1-eda7730dd76b for instance 27eed777-874a-4f63-898a-6d4f77aef89d on hv-cinder-79128 May 28 14:25:28.502245 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-70ce9560-479b-4e03-8f67-be33802fc01c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050899 May 28 14:25:28.503148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 213/448] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:25:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:25:28.919680 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 204 len: 0 microversion: 2.1 time: 0.571189 May 28 14:25:28.920541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 236/449] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:25:28 2021] DELETE /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:25:28.929360 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e26e59c8-4179-441d-990a-806394694691 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:28.930302 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e26e59c8-4179-441d-990a-806394694691 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:28.939121 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e26e59c8-4179-441d-990a-806394694691 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:28.940180 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e26e59c8-4179-441d-990a-806394694691 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:28.941232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e26e59c8-4179-441d-990a-806394694691 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:28.942333 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e26e59c8-4179-441d-990a-806394694691 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:29.017119 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:29.018210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:29.026902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:29.027359 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:29.028176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:29.028830 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:29.194305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e26e59c8-4179-441d-990a-806394694691 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:29.209160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e26e59c8-4179-441d-990a-806394694691 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.283877 May 28 14:25:29.220368 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 214/450] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:28 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:29.227684 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:29.228783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:29.244060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:29.244635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:29.245539 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:29.246327 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:29.479897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:29.491197 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1507 microversion: 2.1 time: 0.479100 May 28 14:25:29.492684 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 237/451] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:29 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1507 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:29.499957 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1562eb16-01e1-400a-a949-c610e22fe343 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:29.500966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1562eb16-01e1-400a-a949-c610e22fe343 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:29.504667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:29.515100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.292984 May 28 14:25:29.516151 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 215/452] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:29 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:29.526240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1562eb16-01e1-400a-a949-c610e22fe343 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:29.526969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1562eb16-01e1-400a-a949-c610e22fe343 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:29.528350 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1562eb16-01e1-400a-a949-c610e22fe343 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:29.528925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1562eb16-01e1-400a-a949-c610e22fe343 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:30.229799 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-60a258e8-5a8c-4688-bd60-bbab392e8a72 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:30.230932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-60a258e8-5a8c-4688-bd60-bbab392e8a72 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:30.237879 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60a258e8-5a8c-4688-bd60-bbab392e8a72 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:30.238436 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60a258e8-5a8c-4688-bd60-bbab392e8a72 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:30.239293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60a258e8-5a8c-4688-bd60-bbab392e8a72 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:30.239843 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60a258e8-5a8c-4688-bd60-bbab392e8a72 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:30.450818 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-60a258e8-5a8c-4688-bd60-bbab392e8a72 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:30.460503 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-60a258e8-5a8c-4688-bd60-bbab392e8a72 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.234426 May 28 14:25:30.461093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 216/453] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:30 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:30.533628 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c53682f0-a4b3-465c-a8c8-142ff6899026 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:30.534273 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c53682f0-a4b3-465c-a8c8-142ff6899026 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:30.542299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c53682f0-a4b3-465c-a8c8-142ff6899026 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:30.542764 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c53682f0-a4b3-465c-a8c8-142ff6899026 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:30.543633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c53682f0-a4b3-465c-a8c8-142ff6899026 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:30.544122 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c53682f0-a4b3-465c-a8c8-142ff6899026 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:30.828848 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c53682f0-a4b3-465c-a8c8-142ff6899026 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:30.841443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c53682f0-a4b3-465c-a8c8-142ff6899026 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.312774 May 28 14:25:30.842614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 217/454] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:30 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:31.344321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5cc87866-b080-4ef8-8c5e-9454d4dc883f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Action: 'create', calling method: .version_select at 0x7f2aae6800d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1591401235"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:31.367436 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-5cc87866-b080-4ef8-8c5e-9454d4dc883f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for project c6d2d25991f04f00a48394ddbeec688e. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:25:31.371950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-5cc87866-b080-4ef8-8c5e-9454d4dc883f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for user 75fb81f5f54947be9db03d07ad8d6ebb and project c6d2d25991f04f00a48394ddbeec688e. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:25:31.856893 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-5cc87866-b080-4ef8-8c5e-9454d4dc883f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for project c6d2d25991f04f00a48394ddbeec688e. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:25:31.861694 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-5cc87866-b080-4ef8-8c5e-9454d4dc883f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for user 75fb81f5f54947be9db03d07ad8d6ebb and project c6d2d25991f04f00a48394ddbeec688e. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:25:31.876052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5cc87866-b080-4ef8-8c5e-9454d4dc883f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.762233 May 28 14:25:31.876913 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 218/455] 10.222.0.59 () {60 vars in 1158 bytes} [Fri May 28 14:25:31 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:31.881522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b6a0d291-8ef0-471a-8d04-15632cd0b3af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:31.882415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b6a0d291-8ef0-471a-8d04-15632cd0b3af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:31.890149 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b6a0d291-8ef0-471a-8d04-15632cd0b3af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:31.890870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b6a0d291-8ef0-471a-8d04-15632cd0b3af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:31.891900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b6a0d291-8ef0-471a-8d04-15632cd0b3af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:31.892555 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b6a0d291-8ef0-471a-8d04-15632cd0b3af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:32.105644 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b6a0d291-8ef0-471a-8d04-15632cd0b3af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:32.119894 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b6a0d291-8ef0-471a-8d04-15632cd0b3af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.241699 May 28 14:25:32.120478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 219/456] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:31 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:32.125146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b45944ca-da94-42dd-ac34-51c6db502fa9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:32.125677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b45944ca-da94-42dd-ac34-51c6db502fa9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:32.133033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b45944ca-da94-42dd-ac34-51c6db502fa9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:32.133489 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b45944ca-da94-42dd-ac34-51c6db502fa9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:32.134329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b45944ca-da94-42dd-ac34-51c6db502fa9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:32.134827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b45944ca-da94-42dd-ac34-51c6db502fa9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:32.360175 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b45944ca-da94-42dd-ac34-51c6db502fa9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:32.380643 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b45944ca-da94-42dd-ac34-51c6db502fa9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.258687 May 28 14:25:32.382063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 220/457] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:32 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:33.136799 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7f1c81a0-d8fe-4141-a1da-e1706008f7da tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:33.137417 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7f1c81a0-d8fe-4141-a1da-e1706008f7da tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:33.145148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f1c81a0-d8fe-4141-a1da-e1706008f7da tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:33.145519 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f1c81a0-d8fe-4141-a1da-e1706008f7da tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:33.146339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f1c81a0-d8fe-4141-a1da-e1706008f7da tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:33.146780 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f1c81a0-d8fe-4141-a1da-e1706008f7da tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:33.470100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7f1c81a0-d8fe-4141-a1da-e1706008f7da tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:33.478334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7f1c81a0-d8fe-4141-a1da-e1706008f7da tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.345481 May 28 14:25:33.478910 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 221/458] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:33 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:33.488483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ce4a77d9-247b-44d2-a723-e88b07394d8e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:33.488483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ce4a77d9-247b-44d2-a723-e88b07394d8e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:33.491703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ce4a77d9-247b-44d2-a723-e88b07394d8e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:33.492415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ce4a77d9-247b-44d2-a723-e88b07394d8e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:33.493251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ce4a77d9-247b-44d2-a723-e88b07394d8e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:33.493708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ce4a77d9-247b-44d2-a723-e88b07394d8e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:33.733390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ce4a77d9-247b-44d2-a723-e88b07394d8e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:33.742449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ce4a77d9-247b-44d2-a723-e88b07394d8e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.262138 May 28 14:25:33.743694 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 222/459] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:33 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:34.236589 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1562eb16-01e1-400a-a949-c610e22fe343 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 4.743186 May 28 14:25:34.237948 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 238/460] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:29 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 4746 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:34.500351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e3373a09-9c86-4712-b823-dab7c6499931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:34.501086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e3373a09-9c86-4712-b823-dab7c6499931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:34.512887 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3373a09-9c86-4712-b823-dab7c6499931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.513270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3373a09-9c86-4712-b823-dab7c6499931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.514238 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3373a09-9c86-4712-b823-dab7c6499931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.514852 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e3373a09-9c86-4712-b823-dab7c6499931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.760421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:34.761134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:34.771390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.773274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.774294 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.774921 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.782676 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e3373a09-9c86-4712-b823-dab7c6499931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:34.793888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e3373a09-9c86-4712-b823-dab7c6499931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.300706 May 28 14:25:34.802611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 223/461] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:34 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:35.250030 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-188d6c4a-783b-423d-b077-b754c65c8370 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:35.251232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-188d6c4a-783b-423d-b077-b754c65c8370 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:35.282932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-188d6c4a-783b-423d-b077-b754c65c8370 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:35.282932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-188d6c4a-783b-423d-b077-b754c65c8370 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:35.282932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-188d6c4a-783b-423d-b077-b754c65c8370 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:35.282932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-188d6c4a-783b-423d-b077-b754c65c8370 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:35.394081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:35.409216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.652870 May 28 14:25:35.410540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-188d6c4a-783b-423d-b077-b754c65c8370 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.160962 May 28 14:25:35.415329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 224/463] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:35 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:35.415665 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 239/463] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:34 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:35.813654 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-899d0fb9-43af-4494-8516-ea5bc8a11a25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:35.814664 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-899d0fb9-43af-4494-8516-ea5bc8a11a25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:35.825237 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-899d0fb9-43af-4494-8516-ea5bc8a11a25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:35.825702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-899d0fb9-43af-4494-8516-ea5bc8a11a25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:35.826611 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-899d0fb9-43af-4494-8516-ea5bc8a11a25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:35.827059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-899d0fb9-43af-4494-8516-ea5bc8a11a25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:36.210482 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-899d0fb9-43af-4494-8516-ea5bc8a11a25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:36.219488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-899d0fb9-43af-4494-8516-ea5bc8a11a25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.411144 May 28 14:25:36.220132 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 240/464] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:35 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:36.423182 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-37972916-c9a4-49af-9c08-ccb58cc7083f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:36.424515 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-37972916-c9a4-49af-9c08-ccb58cc7083f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:36.426401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c4c84731-e1bf-46ed-a049-90d5c99939b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:36.427097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c4c84731-e1bf-46ed-a049-90d5c99939b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:36.432510 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-37972916-c9a4-49af-9c08-ccb58cc7083f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:36.433028 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-37972916-c9a4-49af-9c08-ccb58cc7083f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:36.433819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-37972916-c9a4-49af-9c08-ccb58cc7083f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:36.434263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-37972916-c9a4-49af-9c08-ccb58cc7083f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:36.434562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4c84731-e1bf-46ed-a049-90d5c99939b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:36.435027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4c84731-e1bf-46ed-a049-90d5c99939b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:36.436856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4c84731-e1bf-46ed-a049-90d5c99939b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:36.437009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4c84731-e1bf-46ed-a049-90d5c99939b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:36.650865 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c4c84731-e1bf-46ed-a049-90d5c99939b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:36.660498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c4c84731-e1bf-46ed-a049-90d5c99939b3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.237943 May 28 14:25:36.661096 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 241/465] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:36 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:36.866225 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-37972916-c9a4-49af-9c08-ccb58cc7083f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.447333 May 28 14:25:36.866955 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 225/466] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:36 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:37.239740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ddf6395f-de54-4072-adf3-7524bd2ffe67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:37.240478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ddf6395f-de54-4072-adf3-7524bd2ffe67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:37.248770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddf6395f-de54-4072-adf3-7524bd2ffe67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:37.249321 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddf6395f-de54-4072-adf3-7524bd2ffe67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:37.250139 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddf6395f-de54-4072-adf3-7524bd2ffe67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:37.250619 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddf6395f-de54-4072-adf3-7524bd2ffe67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:37.457986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ddf6395f-de54-4072-adf3-7524bd2ffe67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:37.467725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ddf6395f-de54-4072-adf3-7524bd2ffe67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.231552 May 28 14:25:37.468776 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 242/467] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:37 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:37.677530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-197b20b6-8b29-4cc0-82da-385a2fe58f12 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:37.678327 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-197b20b6-8b29-4cc0-82da-385a2fe58f12 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:37.688306 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-197b20b6-8b29-4cc0-82da-385a2fe58f12 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:37.688761 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-197b20b6-8b29-4cc0-82da-385a2fe58f12 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:37.689620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-197b20b6-8b29-4cc0-82da-385a2fe58f12 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:37.690055 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-197b20b6-8b29-4cc0-82da-385a2fe58f12 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:37.879101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-08a753db-fbdf-47f8-bee7-fb2ca348d52c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:37.880192 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-08a753db-fbdf-47f8-bee7-fb2ca348d52c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:37.889728 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-08a753db-fbdf-47f8-bee7-fb2ca348d52c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:37.890267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-08a753db-fbdf-47f8-bee7-fb2ca348d52c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:37.891152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-08a753db-fbdf-47f8-bee7-fb2ca348d52c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:37.891706 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-08a753db-fbdf-47f8-bee7-fb2ca348d52c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:37.891955 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-197b20b6-8b29-4cc0-82da-385a2fe58f12 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:37.900194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-197b20b6-8b29-4cc0-82da-385a2fe58f12 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.227035 May 28 14:25:37.901076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 226/468] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:37 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:38.484984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:38.485706 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:38.493312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:38.494917 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:38.495741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:38.496186 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:38.697612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:38.705739 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.225178 May 28 14:25:38.706301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 227/469] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:38 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:38.918029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:38.918671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:38.925980 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:38.926430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:38.927203 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:38.927672 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:39.125470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:39.133697 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.219434 May 28 14:25:39.134272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 228/470] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:38 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:39.722068 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:39.722708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:39.730154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:39.730615 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:39.731438 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:39.731908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:39.926430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:39.934517 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.216204 May 28 14:25:39.935075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 229/471] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:39 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:40.149979 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:40.150593 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:40.159026 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:40.159481 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:40.160281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:40.160720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:40.359199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:40.367611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.221038 May 28 14:25:40.368189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 230/472] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:40 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:40.952912 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-41b9c719-4905-411d-ad3d-a555b56551d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:40.953555 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-41b9c719-4905-411d-ad3d-a555b56551d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:40.962153 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41b9c719-4905-411d-ad3d-a555b56551d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:40.962613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41b9c719-4905-411d-ad3d-a555b56551d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:40.963407 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41b9c719-4905-411d-ad3d-a555b56551d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:40.963873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41b9c719-4905-411d-ad3d-a555b56551d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:41.163435 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-41b9c719-4905-411d-ad3d-a555b56551d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:41.171807 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-41b9c719-4905-411d-ad3d-a555b56551d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.223860 May 28 14:25:41.172367 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 231/473] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:40 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:41.384527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:41.385140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:41.393043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:41.393493 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:41.394263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:41.394699 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:41.584037 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:41.592224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.211424 May 28 14:25:41.592798 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 232/474] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:41 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:42.194122 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0d279cee-c688-4905-b507-13fadf1f13ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:42.194778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0d279cee-c688-4905-b507-13fadf1f13ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:42.202143 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0d279cee-c688-4905-b507-13fadf1f13ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:42.202596 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0d279cee-c688-4905-b507-13fadf1f13ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:42.203387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0d279cee-c688-4905-b507-13fadf1f13ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:42.203853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0d279cee-c688-4905-b507-13fadf1f13ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:42.406030 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0d279cee-c688-4905-b507-13fadf1f13ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:42.414434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0d279cee-c688-4905-b507-13fadf1f13ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.224078 May 28 14:25:42.415002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 233/475] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:42 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:42.608730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9079db49-5746-4bb0-b104-9a05cee7f7eb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:42.609264 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9079db49-5746-4bb0-b104-9a05cee7f7eb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:42.616581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9079db49-5746-4bb0-b104-9a05cee7f7eb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:42.617044 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9079db49-5746-4bb0-b104-9a05cee7f7eb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:42.618110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9079db49-5746-4bb0-b104-9a05cee7f7eb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:42.618554 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9079db49-5746-4bb0-b104-9a05cee7f7eb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:42.812752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9079db49-5746-4bb0-b104-9a05cee7f7eb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:42.821154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9079db49-5746-4bb0-b104-9a05cee7f7eb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.216252 May 28 14:25:42.821713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 234/476] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:42 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:43.130678 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-08a753db-fbdf-47f8-bee7-fb2ca348d52c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 5.255228 May 28 14:25:43.131646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 243/477] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:37 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 5257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:43.431329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-20027c62-d2e2-49ad-b543-4d32dc910ada tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:43.431883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-20027c62-d2e2-49ad-b543-4d32dc910ada tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:43.439190 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-20027c62-d2e2-49ad-b543-4d32dc910ada tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:43.439682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-20027c62-d2e2-49ad-b543-4d32dc910ada tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:43.440457 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-20027c62-d2e2-49ad-b543-4d32dc910ada tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:43.440901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-20027c62-d2e2-49ad-b543-4d32dc910ada tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:43.636973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-20027c62-d2e2-49ad-b543-4d32dc910ada tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:43.646325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-20027c62-d2e2-49ad-b543-4d32dc910ada tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.218764 May 28 14:25:43.646908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 235/478] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:43 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:43.838752 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6b86a320-7d0a-4132-966b-da542680225c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:43.839462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6b86a320-7d0a-4132-966b-da542680225c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:43.848430 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b86a320-7d0a-4132-966b-da542680225c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:43.848895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b86a320-7d0a-4132-966b-da542680225c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:43.849680 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b86a320-7d0a-4132-966b-da542680225c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:43.850159 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b86a320-7d0a-4132-966b-da542680225c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:44.063848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6b86a320-7d0a-4132-966b-da542680225c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:44.072916 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6b86a320-7d0a-4132-966b-da542680225c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.238272 May 28 14:25:44.073494 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 244/479] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:43 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:44.143003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bc5c7046-e35d-4eac-9237-4abdfbc4ad55 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:44.143984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bc5c7046-e35d-4eac-9237-4abdfbc4ad55 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:44.151440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc5c7046-e35d-4eac-9237-4abdfbc4ad55 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:44.151930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc5c7046-e35d-4eac-9237-4abdfbc4ad55 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:44.152712 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc5c7046-e35d-4eac-9237-4abdfbc4ad55 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:44.153152 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc5c7046-e35d-4eac-9237-4abdfbc4ad55 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:44.298266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bc5c7046-e35d-4eac-9237-4abdfbc4ad55 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.159482 May 28 14:25:44.298916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 236/480] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:44 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:44.664198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-78452a03-8484-486c-bccf-3c9c34ba8d7f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:44.664872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-78452a03-8484-486c-bccf-3c9c34ba8d7f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:44.673099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-78452a03-8484-486c-bccf-3c9c34ba8d7f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:44.673560 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-78452a03-8484-486c-bccf-3c9c34ba8d7f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:44.674360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-78452a03-8484-486c-bccf-3c9c34ba8d7f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:44.674802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-78452a03-8484-486c-bccf-3c9c34ba8d7f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:44.945045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-78452a03-8484-486c-bccf-3c9c34ba8d7f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:44.953852 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-78452a03-8484-486c-bccf-3c9c34ba8d7f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1507 microversion: 2.1 time: 0.293764 May 28 14:25:44.954591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 245/481] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:44 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:45.095280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:45.096679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:45.109396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:45.110088 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:45.111314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:45.111860 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:45.310301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-682ee257-30ba-48c2-85ee-1606ea329be8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:45.311365 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-682ee257-30ba-48c2-85ee-1606ea329be8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:45.326697 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-682ee257-30ba-48c2-85ee-1606ea329be8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:45.330722 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-682ee257-30ba-48c2-85ee-1606ea329be8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:45.331769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-682ee257-30ba-48c2-85ee-1606ea329be8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:45.332405 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-682ee257-30ba-48c2-85ee-1606ea329be8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:45.414057 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:45.435138 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.346463 May 28 14:25:45.439773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 237/482] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:45 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:45.607135 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-682ee257-30ba-48c2-85ee-1606ea329be8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.300632 May 28 14:25:45.608745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 246/483] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:45 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:45.855846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-38fda11c-8848-4ba8-a758-939e3e0d8d5a req-9ec8a9e8-8a95-4153-9cc1-5c5686c508c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5800de57-f9fa-4ca8-9f94-a8880f3c595f", "name": "network-vif-deleted", "tag": "9328e999-33b7-4ad7-9796-283089726539"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:45.857954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:25:45.857954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:25:45.869543 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-38fda11c-8848-4ba8-a758-939e3e0d8d5a req-9ec8a9e8-8a95-4153-9cc1-5c5686c508c9 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:45.870257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-38fda11c-8848-4ba8-a758-939e3e0d8d5a req-9ec8a9e8-8a95-4153-9cc1-5c5686c508c9 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:45.985371 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f510752c-968f-49cc-93e7-1621e5d382b0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:45.987223 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f510752c-968f-49cc-93e7-1621e5d382b0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:45.999042 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f510752c-968f-49cc-93e7-1621e5d382b0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:45.999844 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f510752c-968f-49cc-93e7-1621e5d382b0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:46.001199 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f510752c-968f-49cc-93e7-1621e5d382b0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:46.001858 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f510752c-968f-49cc-93e7-1621e5d382b0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:46.068106 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-38fda11c-8848-4ba8-a758-939e3e0d8d5a req-9ec8a9e8-8a95-4153-9cc1-5c5686c508c9 service nova] Creating event network-vif-deleted:9328e999-33b7-4ad7-9796-283089726539 for instance 5800de57-f9fa-4ca8-9f94-a8880f3c595f on hv-cinder-79128 May 28 14:25:46.073850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-38fda11c-8848-4ba8-a758-939e3e0d8d5a req-9ec8a9e8-8a95-4153-9cc1-5c5686c508c9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222633 May 28 14:25:46.075228 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 238/484] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:25:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:25:46.453447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:46.455969 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:46.465754 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:46.467460 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:46.468615 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:46.469447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:46.556176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f510752c-968f-49cc-93e7-1621e5d382b0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:46.565910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f510752c-968f-49cc-93e7-1621e5d382b0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1465 microversion: 2.1 time: 0.599056 May 28 14:25:46.573184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 247/485] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:45 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1465 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:46.618378 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b87032be-c9ac-4b54-8c59-02dbc2da3263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:46.619305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b87032be-c9ac-4b54-8c59-02dbc2da3263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:46.630937 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b87032be-c9ac-4b54-8c59-02dbc2da3263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:46.631543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b87032be-c9ac-4b54-8c59-02dbc2da3263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:46.632689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b87032be-c9ac-4b54-8c59-02dbc2da3263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:46.633180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b87032be-c9ac-4b54-8c59-02dbc2da3263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:46.688247 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:46.698157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.250525 May 28 14:25:46.706429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 239/486] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:46 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:46.773025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b87032be-c9ac-4b54-8c59-02dbc2da3263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.158029 May 28 14:25:46.774598 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 248/487] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:46 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:47.585594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:47.585594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:47.593352 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.593831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.594622 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.595068 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.666150 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.666604 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.667088 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lazy-loading 'fault' on Instance uuid 5800de57-f9fa-4ca8-9f94-a8880f3c595f {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:25:47.718801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4d7332b5-769f-4375-9cb7-fb291863bb80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:47.719739 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4d7332b5-769f-4375-9cb7-fb291863bb80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:47.730617 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:47.730763 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4d7332b5-769f-4375-9cb7-fb291863bb80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.731177 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4d7332b5-769f-4375-9cb7-fb291863bb80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.733180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4d7332b5-769f-4375-9cb7-fb291863bb80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.733880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4d7332b5-769f-4375-9cb7-fb291863bb80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.744337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dd855e05-855f-475e-b391-23fad4db02c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 200 len: 1311 microversion: 2.1 time: 0.163266 May 28 14:25:47.750933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 240/488] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:47 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:47.788221 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c5f38854-3a4e-4f5a-8d97-db4211ec4498 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:47.789230 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c5f38854-3a4e-4f5a-8d97-db4211ec4498 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:47.797285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5f38854-3a4e-4f5a-8d97-db4211ec4498 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.800294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5f38854-3a4e-4f5a-8d97-db4211ec4498 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.800294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5f38854-3a4e-4f5a-8d97-db4211ec4498 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.800294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5f38854-3a4e-4f5a-8d97-db4211ec4498 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.959150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4d7332b5-769f-4375-9cb7-fb291863bb80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:47.969154 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4d7332b5-769f-4375-9cb7-fb291863bb80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.254884 May 28 14:25:47.970040 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 249/489] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:47 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:47.973409 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c5f38854-3a4e-4f5a-8d97-db4211ec4498 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29613 microversion: 2.20 time: 0.191095 May 28 14:25:47.974422 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 241/490] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:47 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29613 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:48.761302 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:48.761924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 5800de57-f9fa-4ca8-9f94-a8880f3c595f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:48.770704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:48.771166 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:48.771986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:48.772438 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:48.823360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] HTTP exception thrown: Instance 5800de57-f9fa-4ca8-9f94-a8880f3c595f could not be found. May 28 14:25:48.824017 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Returning 404 to user: Instance 5800de57-f9fa-4ca8-9f94-a8880f3c595f could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:25:48.824980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4bbba1e6-0f91-424c-82f5-14c444098efd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f" status: 404 len: 111 microversion: 2.1 time: 0.067497 May 28 14:25:48.825633 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 250/491] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:48 2021] GET /compute/v2.1/servers/5800de57-f9fa-4ca8-9f94-a8880f3c595f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:25:48.835296 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d63f8dbb-479d-4d85-9a40-06730dd09594 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:48.835989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d63f8dbb-479d-4d85-9a40-06730dd09594 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:48.843934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d63f8dbb-479d-4d85-9a40-06730dd09594 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:48.844317 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d63f8dbb-479d-4d85-9a40-06730dd09594 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:48.845100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d63f8dbb-479d-4d85-9a40-06730dd09594 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:48.845540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d63f8dbb-479d-4d85-9a40-06730dd09594 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:48.907268 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d63f8dbb-479d-4d85-9a40-06730dd09594 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:25:48.984999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-27ad3127-764f-4ddd-8595-ea6df2976c88 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:48.985970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-27ad3127-764f-4ddd-8595-ea6df2976c88 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:48.993499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27ad3127-764f-4ddd-8595-ea6df2976c88 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:48.993962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27ad3127-764f-4ddd-8595-ea6df2976c88 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:48.994744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27ad3127-764f-4ddd-8595-ea6df2976c88 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:48.995187 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27ad3127-764f-4ddd-8595-ea6df2976c88 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:49.109842 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-27ad3127-764f-4ddd-8595-ea6df2976c88 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 29997 microversion: 2.20 time: 0.128956 May 28 14:25:49.110408 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 251/492] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:48 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 29997 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:49.115547 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-64dbf44e-ad50-407b-b6d3-089e04eddd18 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:49.116259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-64dbf44e-ad50-407b-b6d3-089e04eddd18 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:49.124574 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-64dbf44e-ad50-407b-b6d3-089e04eddd18 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:49.125039 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-64dbf44e-ad50-407b-b6d3-089e04eddd18 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:49.125791 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-64dbf44e-ad50-407b-b6d3-089e04eddd18 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:49.126233 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-64dbf44e-ad50-407b-b6d3-089e04eddd18 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:49.272660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d63f8dbb-479d-4d85-9a40-06730dd09594 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 204 len: 0 microversion: 2.1 time: 0.441822 May 28 14:25:49.273273 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 242/493] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:25:48 2021] DELETE /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:25:49.282380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:49.283215 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:49.290758 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:49.291299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:49.292228 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:49.292746 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:49.334125 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-64dbf44e-ad50-407b-b6d3-089e04eddd18 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:49.343353 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-64dbf44e-ad50-407b-b6d3-089e04eddd18 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.231558 May 28 14:25:49.347594 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 252/494] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:49 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:49.496321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:49.505228 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.227484 May 28 14:25:49.505858 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 243/495] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:49 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:50.121731 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-173f23c7-7214-4f10-b2aa-c1056acc3f24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:50.123783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-173f23c7-7214-4f10-b2aa-c1056acc3f24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:50.130977 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-173f23c7-7214-4f10-b2aa-c1056acc3f24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:50.131428 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-173f23c7-7214-4f10-b2aa-c1056acc3f24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:50.132253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-173f23c7-7214-4f10-b2aa-c1056acc3f24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:50.132694 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-173f23c7-7214-4f10-b2aa-c1056acc3f24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:50.258296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-173f23c7-7214-4f10-b2aa-c1056acc3f24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 31010 microversion: 2.20 time: 0.140382 May 28 14:25:50.259248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 253/496] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:50 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 31010 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:50.360540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-491fd059-edfa-4bde-ac74-f08fc3064d76 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:50.361154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-491fd059-edfa-4bde-ac74-f08fc3064d76 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:50.369492 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-491fd059-edfa-4bde-ac74-f08fc3064d76 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:50.370075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-491fd059-edfa-4bde-ac74-f08fc3064d76 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:50.370875 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-491fd059-edfa-4bde-ac74-f08fc3064d76 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:50.371323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-491fd059-edfa-4bde-ac74-f08fc3064d76 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:50.498499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-ba3c91f8-e957-49b5-a607-0bee81e43fc8 req-78107543-9ced-49ae-ad9c-1c078e259f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27eed777-874a-4f63-898a-6d4f77aef89d", "name": "network-vif-plugged", "status": "completed", "tag": "5e55d283-7678-4380-b5d1-eda7730dd76b"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:50.500261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:25:50.500261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:25:50.510106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-ba3c91f8-e957-49b5-a607-0bee81e43fc8 req-78107543-9ced-49ae-ad9c-1c078e259f2d service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:50.510495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-ba3c91f8-e957-49b5-a607-0bee81e43fc8 req-78107543-9ced-49ae-ad9c-1c078e259f2d service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:50.527405 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-ba3c91f8-e957-49b5-a607-0bee81e43fc8 req-78107543-9ced-49ae-ad9c-1c078e259f2d service nova] Creating event network-vif-plugged:5e55d283-7678-4380-b5d1-eda7730dd76b for instance 27eed777-874a-4f63-898a-6d4f77aef89d on hv-cinder-79128 May 28 14:25:50.534293 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-ba3c91f8-e957-49b5-a607-0bee81e43fc8 req-78107543-9ced-49ae-ad9c-1c078e259f2d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038852 May 28 14:25:50.534293 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 254/497] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:25:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:25:50.538455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-004d1834-bf6d-496c-858d-b88c3622ad19 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:50.539400 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-004d1834-bf6d-496c-858d-b88c3622ad19 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:50.547738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-004d1834-bf6d-496c-858d-b88c3622ad19 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:50.548209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-004d1834-bf6d-496c-858d-b88c3622ad19 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:50.549803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-004d1834-bf6d-496c-858d-b88c3622ad19 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:50.549803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-004d1834-bf6d-496c-858d-b88c3622ad19 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:50.658546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-491fd059-edfa-4bde-ac74-f08fc3064d76 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:50.670277 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-491fd059-edfa-4bde-ac74-f08fc3064d76 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.312894 May 28 14:25:50.681385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 244/498] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:50 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:50.893221 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-004d1834-bf6d-496c-858d-b88c3622ad19 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:50.901845 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-004d1834-bf6d-496c-858d-b88c3622ad19 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.367512 May 28 14:25:50.902493 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 255/499] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:50 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:51.272060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0a1f51f0-ab89-401b-a370-2d1ccc2c8b6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:51.273639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0a1f51f0-ab89-401b-a370-2d1ccc2c8b6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:51.282365 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a1f51f0-ab89-401b-a370-2d1ccc2c8b6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:51.282823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a1f51f0-ab89-401b-a370-2d1ccc2c8b6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:51.283635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a1f51f0-ab89-401b-a370-2d1ccc2c8b6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:51.284084 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a1f51f0-ab89-401b-a370-2d1ccc2c8b6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:51.440711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0a1f51f0-ab89-401b-a370-2d1ccc2c8b6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 31912 microversion: 2.20 time: 0.173445 May 28 14:25:51.442019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 245/500] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:51 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 31912 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:51.688317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-21ebdd9a-3955-4e72-b8c8-a2175accf513 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:51.688781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-21ebdd9a-3955-4e72-b8c8-a2175accf513 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:51.696844 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-21ebdd9a-3955-4e72-b8c8-a2175accf513 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:51.697613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-21ebdd9a-3955-4e72-b8c8-a2175accf513 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:51.698420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-21ebdd9a-3955-4e72-b8c8-a2175accf513 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:51.698870 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-21ebdd9a-3955-4e72-b8c8-a2175accf513 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:51.916162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-21ebdd9a-3955-4e72-b8c8-a2175accf513 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:51.920213 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:51.920922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:51.924851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-21ebdd9a-3955-4e72-b8c8-a2175accf513 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.241338 May 28 14:25:51.925828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 256/501] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:51 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:51.928897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:51.929400 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:51.930168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:51.930609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:52.134812 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:52.143598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.227810 May 28 14:25:52.144167 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 246/502] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:51 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:52.453505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c42acf9c-c4b6-4ddd-9872-12257017a9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:52.454484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c42acf9c-c4b6-4ddd-9872-12257017a9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:52.461831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c42acf9c-c4b6-4ddd-9872-12257017a9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:52.462301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c42acf9c-c4b6-4ddd-9872-12257017a9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:52.463095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c42acf9c-c4b6-4ddd-9872-12257017a9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:52.463540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c42acf9c-c4b6-4ddd-9872-12257017a9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:52.625887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c42acf9c-c4b6-4ddd-9872-12257017a9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 32605 microversion: 2.20 time: 0.176340 May 28 14:25:52.626954 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 257/503] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:52 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 32605 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:52.944681 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-181f9364-3ce4-41a5-8650-5298821a028a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:52.946964 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-181f9364-3ce4-41a5-8650-5298821a028a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:52.968685 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-181f9364-3ce4-41a5-8650-5298821a028a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:52.969850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-181f9364-3ce4-41a5-8650-5298821a028a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:52.970912 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-181f9364-3ce4-41a5-8650-5298821a028a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:52.971524 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-181f9364-3ce4-41a5-8650-5298821a028a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:53.166822 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-673edda1-0bae-4dab-9ad8-ed2d5396374f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:53.168574 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-673edda1-0bae-4dab-9ad8-ed2d5396374f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:53.177565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-181f9364-3ce4-41a5-8650-5298821a028a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:53.178442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-673edda1-0bae-4dab-9ad8-ed2d5396374f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:53.179141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-673edda1-0bae-4dab-9ad8-ed2d5396374f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:53.180260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-673edda1-0bae-4dab-9ad8-ed2d5396374f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:53.180795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-673edda1-0bae-4dab-9ad8-ed2d5396374f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:53.186202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-181f9364-3ce4-41a5-8650-5298821a028a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1313 microversion: 2.1 time: 0.247961 May 28 14:25:53.187966 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 247/504] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:52 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:53.506398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-673edda1-0bae-4dab-9ad8-ed2d5396374f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:53.515357 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-673edda1-0bae-4dab-9ad8-ed2d5396374f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.352590 May 28 14:25:53.516036 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 258/505] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:53 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:25:53.637925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9d422c8d-8219-4583-817e-96bd35856d73 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:53.638854 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9d422c8d-8219-4583-817e-96bd35856d73 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:53.646165 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9d422c8d-8219-4583-817e-96bd35856d73 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:53.646620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9d422c8d-8219-4583-817e-96bd35856d73 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:53.647399 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9d422c8d-8219-4583-817e-96bd35856d73 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:53.647866 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9d422c8d-8219-4583-817e-96bd35856d73 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:53.796892 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9d422c8d-8219-4583-817e-96bd35856d73 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 33312 microversion: 2.20 time: 0.162556 May 28 14:25:53.800924 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 248/506] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:53 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 33312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:54.202927 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dc8e2961-af6f-45a6-9962-5a555438a214 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:54.203758 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-dc8e2961-af6f-45a6-9962-5a555438a214 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:54.211441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dc8e2961-af6f-45a6-9962-5a555438a214 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:54.211942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dc8e2961-af6f-45a6-9962-5a555438a214 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:54.212774 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dc8e2961-af6f-45a6-9962-5a555438a214 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:54.213254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dc8e2961-af6f-45a6-9962-5a555438a214 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:54.451316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-dc8e2961-af6f-45a6-9962-5a555438a214 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:54.459896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-dc8e2961-af6f-45a6-9962-5a555438a214 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1496 microversion: 2.1 time: 0.260786 May 28 14:25:54.460467 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 259/507] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:54 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1496 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:54.534684 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e1529a88-ff10-432a-9919-4bc8b84b799b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:54.535527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e1529a88-ff10-432a-9919-4bc8b84b799b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:54.543509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1529a88-ff10-432a-9919-4bc8b84b799b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:54.544063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1529a88-ff10-432a-9919-4bc8b84b799b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:54.545262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1529a88-ff10-432a-9919-4bc8b84b799b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:54.545262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1529a88-ff10-432a-9919-4bc8b84b799b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:54.788559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e1529a88-ff10-432a-9919-4bc8b84b799b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:54.796694 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e1529a88-ff10-432a-9919-4bc8b84b799b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.266421 May 28 14:25:54.797328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 249/508] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:54 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:54.808644 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-de7aa654-eb57-4320-8aec-19302992a8d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:54.809599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-de7aa654-eb57-4320-8aec-19302992a8d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:54.818428 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de7aa654-eb57-4320-8aec-19302992a8d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:54.819163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de7aa654-eb57-4320-8aec-19302992a8d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:54.820021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de7aa654-eb57-4320-8aec-19302992a8d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:54.820491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de7aa654-eb57-4320-8aec-19302992a8d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:54.942176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-de7aa654-eb57-4320-8aec-19302992a8d3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 33980 microversion: 2.20 time: 0.137145 May 28 14:25:54.946429 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 260/509] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:54 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 33980 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:55.817440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:55.818696 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:55.827873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:55.828345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:55.829194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:55.829672 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:55.956307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fa13e167-8d09-454d-aaad-d8eb1e286f34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:55.958673 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fa13e167-8d09-454d-aaad-d8eb1e286f34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:55.970618 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa13e167-8d09-454d-aaad-d8eb1e286f34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:55.971325 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa13e167-8d09-454d-aaad-d8eb1e286f34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:55.972501 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa13e167-8d09-454d-aaad-d8eb1e286f34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:55.973095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa13e167-8d09-454d-aaad-d8eb1e286f34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:56.073188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:56.087080 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.274776 May 28 14:25:56.089109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 250/510] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:55 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:56.094707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:56.095687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:56.104501 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:56.104785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fa13e167-8d09-454d-aaad-d8eb1e286f34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 34388 microversion: 2.20 time: 0.153852 May 28 14:25:56.105627 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 261/511] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:55 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 34388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:56.105994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:56.106906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:56.107449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:56.179246 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:25:56.573930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "DELETE /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 204 len: 0 microversion: 2.1 time: 0.483010 May 28 14:25:56.575281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 251/512] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:25:56 2021] DELETE /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:25:56.589380 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-861044f9-de18-4475-a6e5-4e5fd6cfab0d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:56.590137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-861044f9-de18-4475-a6e5-4e5fd6cfab0d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:56.601591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-861044f9-de18-4475-a6e5-4e5fd6cfab0d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:56.602042 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-861044f9-de18-4475-a6e5-4e5fd6cfab0d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:56.603165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-861044f9-de18-4475-a6e5-4e5fd6cfab0d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:56.603797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-861044f9-de18-4475-a6e5-4e5fd6cfab0d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:56.927960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-861044f9-de18-4475-a6e5-4e5fd6cfab0d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:56.938962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-861044f9-de18-4475-a6e5-4e5fd6cfab0d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1502 microversion: 2.1 time: 0.356009 May 28 14:25:56.938962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 262/513] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:56 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1502 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:57.110989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-79c899ff-c827-4f51-bf84-f0b9656de2cd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:57.112301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-79c899ff-c827-4f51-bf84-f0b9656de2cd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:57.124874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-da61e60e-78b6-4e3d-ae4d-6beefbc5442b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:57.129253 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79c899ff-c827-4f51-bf84-f0b9656de2cd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:57.129836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79c899ff-c827-4f51-bf84-f0b9656de2cd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:57.130711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79c899ff-c827-4f51-bf84-f0b9656de2cd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:57.131282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79c899ff-c827-4f51-bf84-f0b9656de2cd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:57.136381 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-da61e60e-78b6-4e3d-ae4d-6beefbc5442b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:57.144433 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da61e60e-78b6-4e3d-ae4d-6beefbc5442b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:57.145102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da61e60e-78b6-4e3d-ae4d-6beefbc5442b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:57.145937 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da61e60e-78b6-4e3d-ae4d-6beefbc5442b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:57.146390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da61e60e-78b6-4e3d-ae4d-6beefbc5442b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:57.304176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-da61e60e-78b6-4e3d-ae4d-6beefbc5442b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 34695 microversion: 2.20 time: 0.184155 May 28 14:25:57.305300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 263/514] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:57 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 34695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:57.383067 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-79c899ff-c827-4f51-bf84-f0b9656de2cd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:57.392270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-79c899ff-c827-4f51-bf84-f0b9656de2cd tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.290070 May 28 14:25:57.393137 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 252/515] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:57 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:57.956453 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:57.957413 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:57.967991 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:57.969373 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:57.970769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:57.971857 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:58.315844 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4f9c40f6-412d-49d1-9167-ee9a567e70a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:58.317085 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4f9c40f6-412d-49d1-9167-ee9a567e70a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:58.329842 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f9c40f6-412d-49d1-9167-ee9a567e70a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:58.340127 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f9c40f6-412d-49d1-9167-ee9a567e70a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:58.341614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f9c40f6-412d-49d1-9167-ee9a567e70a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:58.342184 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f9c40f6-412d-49d1-9167-ee9a567e70a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:58.381247 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:58.390646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1502 microversion: 2.1 time: 0.438517 May 28 14:25:58.391230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 264/516] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:57 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1502 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:58.414046 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-664b2efc-cd73-442b-b00c-0649bc9bad40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:58.414673 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-664b2efc-cd73-442b-b00c-0649bc9bad40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:58.422221 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-664b2efc-cd73-442b-b00c-0649bc9bad40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:58.422689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-664b2efc-cd73-442b-b00c-0649bc9bad40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:58.423530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-664b2efc-cd73-442b-b00c-0649bc9bad40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:58.424039 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-664b2efc-cd73-442b-b00c-0649bc9bad40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:58.472204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4f9c40f6-412d-49d1-9167-ee9a567e70a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 35148 microversion: 2.20 time: 0.159868 May 28 14:25:58.477218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 253/517] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:58 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 35148 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:25:58.758248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-664b2efc-cd73-442b-b00c-0649bc9bad40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:58.766641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-664b2efc-cd73-442b-b00c-0649bc9bad40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.356604 May 28 14:25:58.767240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 265/518] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:58 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:59.410020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:59.410735 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:59.419156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:59.420174 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:59.422406 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:59.422406 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:59.487961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-728ade24-d518-429f-8aa0-be744715d1b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:25:59.489027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-728ade24-d518-429f-8aa0-be744715d1b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:59.501045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-728ade24-d518-429f-8aa0-be744715d1b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:59.501506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-728ade24-d518-429f-8aa0-be744715d1b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:59.502311 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-728ade24-d518-429f-8aa0-be744715d1b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:59.502762 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-728ade24-d518-429f-8aa0-be744715d1b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:59.637470 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-728ade24-d518-429f-8aa0-be744715d1b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 35704 microversion: 2.20 time: 0.156553 May 28 14:25:59.638913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 266/519] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:25:59 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 35704 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:25:59.733216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:25:59.741883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1502 microversion: 2.1 time: 0.336065 May 28 14:25:59.742903 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 254/520] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:59 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1502 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:25:59.785816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-eb2c9b95-489d-4865-8512-0f188d82b537 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:25:59.786624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-eb2c9b95-489d-4865-8512-0f188d82b537 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:25:59.794872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eb2c9b95-489d-4865-8512-0f188d82b537 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:59.795580 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eb2c9b95-489d-4865-8512-0f188d82b537 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:59.796659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eb2c9b95-489d-4865-8512-0f188d82b537 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:59.797268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eb2c9b95-489d-4865-8512-0f188d82b537 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:00.639721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-eb2c9b95-489d-4865-8512-0f188d82b537 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:00.651197 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ba00d0c9-5712-4339-a108-9d3da59b087b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:00.651783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-eb2c9b95-489d-4865-8512-0f188d82b537 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1521 microversion: 2.1 time: 0.870621 May 28 14:26:00.652946 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ba00d0c9-5712-4339-a108-9d3da59b087b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:00.654975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 267/521] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:25:59 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1521 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:00.663135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ba00d0c9-5712-4339-a108-9d3da59b087b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:00.663730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ba00d0c9-5712-4339-a108-9d3da59b087b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:00.664586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ba00d0c9-5712-4339-a108-9d3da59b087b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:00.665094 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ba00d0c9-5712-4339-a108-9d3da59b087b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:00.758393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:00.759340 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:00.768269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:00.769106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:00.770101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:00.770740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:00.790500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ba00d0c9-5712-4339-a108-9d3da59b087b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 36313 microversion: 2.20 time: 0.143760 May 28 14:26:00.800136 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 255/522] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:26:00 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 36313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:26:01.549541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:01.562712 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1502 microversion: 2.1 time: 0.807902 May 28 14:26:01.563296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 268/523] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:00 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1502 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:01.655757 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-5da26d79-eb7b-43ef-97d3-cd178b4476db req-7516ea6f-02f2-4bab-8d25-ed9d984f34ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c17d712-c03d-44ac-bd8d-5f9b99160b0f", "name": "network-vif-deleted", "tag": "a600bf0f-8706-4c30-ae48-005a0b8b9b84"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:01.657830 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:26:01.657830 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:26:01.668930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-5da26d79-eb7b-43ef-97d3-cd178b4476db req-7516ea6f-02f2-4bab-8d25-ed9d984f34ea service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:01.670140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-5da26d79-eb7b-43ef-97d3-cd178b4476db req-7516ea6f-02f2-4bab-8d25-ed9d984f34ea service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:01.681831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fdb18f81-00d4-4415-ae5a-b64548d0e281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:01.683274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fdb18f81-00d4-4415-ae5a-b64548d0e281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:01.716351 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fdb18f81-00d4-4415-ae5a-b64548d0e281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:01.719502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fdb18f81-00d4-4415-ae5a-b64548d0e281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:01.721216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fdb18f81-00d4-4415-ae5a-b64548d0e281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:01.722641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fdb18f81-00d4-4415-ae5a-b64548d0e281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:01.725386 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-5da26d79-eb7b-43ef-97d3-cd178b4476db req-7516ea6f-02f2-4bab-8d25-ed9d984f34ea service nova] Creating event network-vif-deleted:a600bf0f-8706-4c30-ae48-005a0b8b9b84 for instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f on hv-cinder-79128 May 28 14:26:01.736283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-5da26d79-eb7b-43ef-97d3-cd178b4476db req-7516ea6f-02f2-4bab-8d25-ed9d984f34ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080402 May 28 14:26:01.737718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 256/524] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:26:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:26:01.823972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-db08e25e-fb05-4127-9021-ed60ebf54805 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:01.825864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-db08e25e-fb05-4127-9021-ed60ebf54805 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:01.838019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-db08e25e-fb05-4127-9021-ed60ebf54805 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:01.838840 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-db08e25e-fb05-4127-9021-ed60ebf54805 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:01.840133 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-db08e25e-fb05-4127-9021-ed60ebf54805 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:01.840943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-db08e25e-fb05-4127-9021-ed60ebf54805 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:01.983880 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-db08e25e-fb05-4127-9021-ed60ebf54805 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 37192 microversion: 2.20 time: 0.179547 May 28 14:26:01.984977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 257/525] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:26:01 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 37192 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:26:02.158453 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fdb18f81-00d4-4415-ae5a-b64548d0e281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4720d0d2604545bfbd08e665b32fb612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:02.167121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fdb18f81-00d4-4415-ae5a-b64548d0e281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 200 len: 1479 microversion: 2.1 time: 0.501061 May 28 14:26:02.167853 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 269/526] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:01 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 1479 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:02.580927 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:02.581707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:02.590047 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:02.590512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:02.591970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:02.592401 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:02.663309 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:02.664095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:02.664318 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lazy-loading 'fault' on Instance uuid 27eed777-874a-4f63-898a-6d4f77aef89d {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:26:02.724295 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfb66238fe64034b35f81b0f7e76fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba85ed1a1a14a848b3f33435440dff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:02.732683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-301001e6-12f2-4fdf-8290-cad447729c29 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 200 len: 1303 microversion: 2.1 time: 0.156016 May 28 14:26:02.734087 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 258/527] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:02 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:03.002846 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-69ce3f28-5093-422c-8604-aca43fde1e24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:03.004503 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-69ce3f28-5093-422c-8604-aca43fde1e24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:03.022155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69ce3f28-5093-422c-8604-aca43fde1e24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:03.022761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69ce3f28-5093-422c-8604-aca43fde1e24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:03.023733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69ce3f28-5093-422c-8604-aca43fde1e24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:03.024176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69ce3f28-5093-422c-8604-aca43fde1e24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:03.191574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:03.192406 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] [instance: 9c17d712-c03d-44ac-bd8d-5f9b99160b0f] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:03.201001 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:03.201463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:03.206411 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-69ce3f28-5093-422c-8604-aca43fde1e24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 37965 microversion: 2.20 time: 0.213698 May 28 14:26:03.207768 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 270/528] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:26:02 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 37965 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:26:03.208249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:03.208896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:03.264281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] HTTP exception thrown: Instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f could not be found. May 28 14:26:03.265347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Returning 404 to user: Instance 9c17d712-c03d-44ac-bd8d-5f9b99160b0f could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:26:03.266460 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7afc384a-19c0-4a03-b799-2f70428c0e65 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f" status: 404 len: 111 microversion: 2.1 time: 0.085701 May 28 14:26:03.267600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 259/529] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:03 2021] GET /compute/v2.1/servers/9c17d712-c03d-44ac-bd8d-5f9b99160b0f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:26:03.751881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:03.752811 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] [instance: 27eed777-874a-4f63-898a-6d4f77aef89d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:03.761906 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:03.762546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-ea2d884d-9f70-49ae-aec3-d79a1b5cb252 req-c7012ef4-6890-40f1-87d8-1464e5625cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27eed777-874a-4f63-898a-6d4f77aef89d", "name": "network-vif-deleted", "tag": "5e55d283-7678-4380-b5d1-eda7730dd76b"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:03.763148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:03.763740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:03.764259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:03.764375 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:26:03.764375 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:26:03.774487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-ea2d884d-9f70-49ae-aec3-d79a1b5cb252 req-c7012ef4-6890-40f1-87d8-1464e5625cb5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:03.775322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-ea2d884d-9f70-49ae-aec3-d79a1b5cb252 req-c7012ef4-6890-40f1-87d8-1464e5625cb5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:03.797110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-ea2d884d-9f70-49ae-aec3-d79a1b5cb252 req-c7012ef4-6890-40f1-87d8-1464e5625cb5 service nova] Creating event network-vif-deleted:5e55d283-7678-4380-b5d1-eda7730dd76b for instance 27eed777-874a-4f63-898a-6d4f77aef89d on hv-cinder-79128 May 28 14:26:03.804691 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-ea2d884d-9f70-49ae-aec3-d79a1b5cb252 req-c7012ef4-6890-40f1-87d8-1464e5625cb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045173 May 28 14:26:03.805814 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 260/530] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:26:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:26:03.846125 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] HTTP exception thrown: Instance 27eed777-874a-4f63-898a-6d4f77aef89d could not be found. May 28 14:26:03.847791 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Returning 404 to user: Instance 27eed777-874a-4f63-898a-6d4f77aef89d could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:26:03.849155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-dbe97572-57a6-42d2-9e73-1a8081ab7405 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d" status: 404 len: 111 microversion: 2.1 time: 0.102988 May 28 14:26:03.850228 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 271/531] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:03 2021] GET /compute/v2.1/servers/27eed777-874a-4f63-898a-6d4f77aef89d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:26:04.219609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fea06567-2269-41cc-85c4-88d1a0e679b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:04.221194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fea06567-2269-41cc-85c4-88d1a0e679b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:04.236821 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fea06567-2269-41cc-85c4-88d1a0e679b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:04.237771 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fea06567-2269-41cc-85c4-88d1a0e679b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:04.239013 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fea06567-2269-41cc-85c4-88d1a0e679b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:04.239679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fea06567-2269-41cc-85c4-88d1a0e679b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:04.395449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fea06567-2269-41cc-85c4-88d1a0e679b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 38941 microversion: 2.20 time: 0.179869 May 28 14:26:04.397188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 261/532] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:26:04 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 38941 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:26:05.429773 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e25b6750-df0b-4201-91b4-ed364c89cd12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:05.431349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e25b6750-df0b-4201-91b4-ed364c89cd12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:05.442212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e25b6750-df0b-4201-91b4-ed364c89cd12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:05.442916 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e25b6750-df0b-4201-91b4-ed364c89cd12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:05.443917 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e25b6750-df0b-4201-91b4-ed364c89cd12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:05.444523 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e25b6750-df0b-4201-91b4-ed364c89cd12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:05.603580 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e25b6750-df0b-4201-91b4-ed364c89cd12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 39128 microversion: 2.20 time: 0.190059 May 28 14:26:05.604343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 272/533] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:26:05 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 39128 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:26:06.617106 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-90e4eb15-6823-44f2-b593-6d0b5043066a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:06.618443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-90e4eb15-6823-44f2-b593-6d0b5043066a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:06.627289 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-90e4eb15-6823-44f2-b593-6d0b5043066a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:06.627711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-90e4eb15-6823-44f2-b593-6d0b5043066a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:06.628716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-90e4eb15-6823-44f2-b593-6d0b5043066a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:06.628945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-90e4eb15-6823-44f2-b593-6d0b5043066a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:06.754850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-90e4eb15-6823-44f2-b593-6d0b5043066a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 39128 microversion: 2.20 time: 0.142625 May 28 14:26:06.756584 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 262/534] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:26:06 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 39128 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:26:07.778143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4234593e-6bd1-44b0-8f1f-f5a2704eb6eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:07.779183 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4234593e-6bd1-44b0-8f1f-f5a2704eb6eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:07.802079 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4234593e-6bd1-44b0-8f1f-f5a2704eb6eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:07.802816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4234593e-6bd1-44b0-8f1f-f5a2704eb6eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:07.804649 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4234593e-6bd1-44b0-8f1f-f5a2704eb6eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:07.805510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4234593e-6bd1-44b0-8f1f-f5a2704eb6eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:14.939490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4234593e-6bd1-44b0-8f1f-f5a2704eb6eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 200 len: 39269 microversion: 2.20 time: 7.167537 May 28 14:26:14.944290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 273/535] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:26:07 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 39269 bytes in 7173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:26:14.953542 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8f7fa229-90ec-471b-973d-5f29fd821e44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:14.954414 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8f7fa229-90ec-471b-973d-5f29fd821e44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:14.963731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8f7fa229-90ec-471b-973d-5f29fd821e44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:14.964577 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8f7fa229-90ec-471b-973d-5f29fd821e44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:14.965757 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8f7fa229-90ec-471b-973d-5f29fd821e44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:14.966419 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8f7fa229-90ec-471b-973d-5f29fd821e44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:15.100859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8f7fa229-90ec-471b-973d-5f29fd821e44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/ips" status: 200 len: 152 microversion: 2.20 time: 0.153450 May 28 14:26:15.107237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 263/536] 10.222.0.59 () {60 vars in 1289 bytes} [Fri May 28 14:26:14 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/ips => generated 152 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:26:18.195812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-789576978", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "37e18bf5-545d-49a2-afdf-585587a7907f"}]}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:20.107722 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c3f5f37a-05e1-4c33-be89-c7b462e07430 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:20.109163 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c3f5f37a-05e1-4c33-be89-c7b462e07430 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:20.131972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c3f5f37a-05e1-4c33-be89-c7b462e07430 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:20.133656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c3f5f37a-05e1-4c33-be89-c7b462e07430 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:20.136322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c3f5f37a-05e1-4c33-be89-c7b462e07430 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:20.137226 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c3f5f37a-05e1-4c33-be89-c7b462e07430 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:20.233792 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-c3f5f37a-05e1-4c33-be89-c7b462e07430 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lazy-loading 'flavor' on Instance uuid 2c36e73b-e6ab-4203-ada8-e971693460e2 {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:26:31.840618 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] validate_networks() for [('37e18bf5-545d-49a2-afdf-585587a7907f', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:26:32.105267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c3f5f37a-05e1-4c33-be89-c7b462e07430 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 202 len: 0 microversion: 2.20 time: 12.278228 May 28 14:26:32.108075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 264/537] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:26:19 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 0 bytes in 12287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 28 14:26:32.115952 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-972e50e3-05ac-4b9d-9374-7922102ea59d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Action: 'create', calling method: .version_select at 0x7f2aad16a160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1563382805"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:32.158963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-972e50e3-05ac-4b9d-9374-7922102ea59d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Getting quotas for project cf7193774c754e07a6f683666ab4addf. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:26:32.170611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-972e50e3-05ac-4b9d-9374-7922102ea59d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Getting quotas for user 92db5e1dd631441795575b3f891f6baa and project cf7193774c754e07a6f683666ab4addf. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:26:32.614098 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:26:32.614518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:26:32.614997 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:26:32.615615 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:26:32.616177 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:26:32.626422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:32.627123 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:32.627961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:32.628580 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:32.647022 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Getting quotas for project 94dc9f7ad5dd40429991c68c00e7ec6d. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:26:32.651399 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Getting quotas for user d9be4db3bc1f4c2386bacaee2c9232ea and project 94dc9f7ad5dd40429991c68c00e7ec6d. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:26:32.664172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:26:32.667060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:26:32.709210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-972e50e3-05ac-4b9d-9374-7922102ea59d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Getting quotas for project cf7193774c754e07a6f683666ab4addf. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:26:32.719396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-972e50e3-05ac-4b9d-9374-7922102ea59d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Getting quotas for user 92db5e1dd631441795575b3f891f6baa and project cf7193774c754e07a6f683666ab4addf. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:26:32.734469 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-972e50e3-05ac-4b9d-9374-7922102ea59d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.624819 May 28 14:26:32.745290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 265/538] 10.222.0.59 () {60 vars in 1158 bytes} [Fri May 28 14:26:32 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:32.745290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:32.745290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:32.754496 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:32.755089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:32.756072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:32.756567 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:32.798459 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-174b3b85-c280-4dce-82a7-73c2d13d3b30 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.973317 May 28 14:26:32.801207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 274/539] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:26:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 14994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:26:32.845482 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e97664c8-b75b-493b-bee9-caeaa8f84951 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:32.847261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e97664c8-b75b-493b-bee9-caeaa8f84951 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:33.008745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e97664c8-b75b-493b-bee9-caeaa8f84951 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:33.018464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e97664c8-b75b-493b-bee9-caeaa8f84951 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1217 microversion: 2.1 time: 0.210626 May 28 14:26:33.023920 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 275/540] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:32 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:33.034822 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1883499604", "imageRef": "c2e2093d-7c29-46bc-888b-d4f4af6efd56", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1563382805", "networks": [{"uuid": "780506d2-6c05-4b1f-af1f-a4a3d627ec86"}]}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:33.108192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:33.123079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:33.124732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:33.126111 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.389049 May 28 14:26:33.127628 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 266/541] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:32 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:33.134893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] validate_networks() for [('780506d2-6c05-4b1f-af1f-a4a3d627ec86', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:26:34.038316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8757c182-7b05-4355-8525-f54508f57ec2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:34.039982 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8757c182-7b05-4355-8525-f54508f57ec2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:34.126460 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:26:34.127306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:26:34.127306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:26:34.127727 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:26:34.128327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:26:34.142737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:34.143370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:34.144372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:34.144978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:34.182661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Getting quotas for project cf7193774c754e07a6f683666ab4addf. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:26:34.188605 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Getting quotas for user 92db5e1dd631441795575b3f891f6baa and project cf7193774c754e07a6f683666ab4addf. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:26:34.200419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:26:34.202939 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2e2093d-7c29-46bc-888b-d4f4af6efd56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:26:34.222162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8757c182-7b05-4355-8525-f54508f57ec2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:34.231663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8757c182-7b05-4355-8525-f54508f57ec2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1217 microversion: 2.1 time: 0.199325 May 28 14:26:34.239791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 267/542] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:34 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1217 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:34.250378 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:34.251220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:34.264717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:34.265470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:34.268882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:34.269551 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:34.432891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406746 May 28 14:26:34.434398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 276/543] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:26:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:26:34.444288 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4c1d29c0-8249-4ea3-b7af-f6a4c8627cd4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:34.445259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4c1d29c0-8249-4ea3-b7af-f6a4c8627cd4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:34.531005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:34.539593 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:34.541159 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:34.542321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-268df132-0d1e-4b78-aa01-e5b3400c5fed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.301205 May 28 14:26:34.543115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 268/544] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:34 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:34.556207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4c1d29c0-8249-4ea3-b7af-f6a4c8627cd4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:34.568870 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4c1d29c0-8249-4ea3-b7af-f6a4c8627cd4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1259 microversion: 2.1 time: 0.128194 May 28 14:26:34.570327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 277/545] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:34 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1259 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:35.264115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e4087421-f699-4fe2-b215-3b74bed0f246 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:35.264904 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e4087421-f699-4fe2-b215-3b74bed0f246 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:35.272785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e4087421-f699-4fe2-b215-3b74bed0f246 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:35.273242 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e4087421-f699-4fe2-b215-3b74bed0f246 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:35.274374 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e4087421-f699-4fe2-b215-3b74bed0f246 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:35.275101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e4087421-f699-4fe2-b215-3b74bed0f246 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:35.437086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e4087421-f699-4fe2-b215-3b74bed0f246 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:35.446687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e4087421-f699-4fe2-b215-3b74bed0f246 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1269 microversion: 2.1 time: 0.186452 May 28 14:26:35.447425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 269/546] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:35 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:35.564224 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:35.565483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:35.573923 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:35.575344 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:35.575795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:35.576243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:35.592864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-62b97820-cb4f-4e21-a1e1-2e706bad4da6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:35.594961 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-62b97820-cb4f-4e21-a1e1-2e706bad4da6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:35.715380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-62b97820-cb4f-4e21-a1e1-2e706bad4da6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:35.726255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-62b97820-cb4f-4e21-a1e1-2e706bad4da6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1259 microversion: 2.1 time: 0.141090 May 28 14:26:35.727172 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 270/547] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:35 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:36.020325 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:36.030143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:36.031947 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:36.033340 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4b755240-19f5-428a-987e-07c6485990c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.475059 May 28 14:26:36.045668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 278/548] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:35 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:36.467181 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-959b35c8-a508-4eee-aaf1-bf76bc17161c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:36.470159 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-959b35c8-a508-4eee-aaf1-bf76bc17161c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:36.502074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-959b35c8-a508-4eee-aaf1-bf76bc17161c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:36.502819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-959b35c8-a508-4eee-aaf1-bf76bc17161c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:36.503915 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-959b35c8-a508-4eee-aaf1-bf76bc17161c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:36.504510 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-959b35c8-a508-4eee-aaf1-bf76bc17161c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:36.646256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-959b35c8-a508-4eee-aaf1-bf76bc17161c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:36.666355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-959b35c8-a508-4eee-aaf1-bf76bc17161c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1277 microversion: 2.1 time: 0.195807 May 28 14:26:36.667378 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 271/549] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:36 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:36.744943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e1693c88-002e-4859-b72d-0a068e0ae88f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:36.746904 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e1693c88-002e-4859-b72d-0a068e0ae88f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:36.755988 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1693c88-002e-4859-b72d-0a068e0ae88f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:36.756472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1693c88-002e-4859-b72d-0a068e0ae88f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:36.757526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1693c88-002e-4859-b72d-0a068e0ae88f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:36.758210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1693c88-002e-4859-b72d-0a068e0ae88f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:36.914716 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e1693c88-002e-4859-b72d-0a068e0ae88f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:36.939973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e1693c88-002e-4859-b72d-0a068e0ae88f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1311 microversion: 2.1 time: 0.190911 May 28 14:26:36.939973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 279/550] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:36 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:37.051718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:37.052338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:37.072770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:37.072770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:37.072770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:37.072770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:37.315900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:37.326038 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:37.329524 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:37.329524 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.281538 May 28 14:26:37.340775 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 272/551] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:37 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:37.675342 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:37.676230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:37.684411 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:37.685679 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:37.688335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:37.688960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:37.839262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:37.857546 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1275 microversion: 2.1 time: 0.186348 May 28 14:26:37.859043 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 280/552] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:37 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:37.951265 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:37.951265 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:37.968445 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:37.968907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:37.969741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:37.970189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:38.123254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:38.135641 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1329 microversion: 2.1 time: 0.189936 May 28 14:26:38.137347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 273/553] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:37 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1329 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:38.348330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:38.349062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:38.372591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:38.375324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:38.376221 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:38.376699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:38.878761 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:38.880625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:38.893071 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:38.936255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:38.936255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:38.936255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:39.098542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:39.115063 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:39.128102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:39.129597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7356494b-e195-4769-9db2-f170d66ed3a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.785504 May 28 14:26:39.140855 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 281/554] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:38 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:39.154251 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-616a8e44-abd4-48df-9909-63e60d528f84 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:39.155387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-616a8e44-abd4-48df-9909-63e60d528f84 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:39.165318 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-616a8e44-abd4-48df-9909-63e60d528f84 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:39.168029 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-616a8e44-abd4-48df-9909-63e60d528f84 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:39.169227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-616a8e44-abd4-48df-9909-63e60d528f84 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:39.169875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-616a8e44-abd4-48df-9909-63e60d528f84 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:39.343109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-616a8e44-abd4-48df-9909-63e60d528f84 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:39.352454 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-616a8e44-abd4-48df-9909-63e60d528f84 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1317 microversion: 2.1 time: 0.202791 May 28 14:26:39.352993 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 282/555] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:39 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:39.443377 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:39.453940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.581658 May 28 14:26:39.456233 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 274/556] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:38 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:40.151679 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:40.152365 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:40.160368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:40.161082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:40.162069 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:40.162696 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:40.370485 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-abde60ce-7947-4cfe-9369-fac09c801318 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:40.371941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-abde60ce-7947-4cfe-9369-fac09c801318 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:40.379844 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-abde60ce-7947-4cfe-9369-fac09c801318 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:40.380545 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-abde60ce-7947-4cfe-9369-fac09c801318 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:40.381341 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-abde60ce-7947-4cfe-9369-fac09c801318 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:40.381909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-abde60ce-7947-4cfe-9369-fac09c801318 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:40.472695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:40.483234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:40.484816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:40.485975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f9277198-358d-44c9-bf55-0de7c7aaffca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.338260 May 28 14:26:40.486534 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 283/557] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:40 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:40.574326 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-7a1e2432-797e-4d7f-8945-63cfa1553a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eac2abf-26a1-4d1d-84ed-ac16a83ef646", "tag": "965a8c13-7f18-4e6d-92f2-16c7c866bcfd"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:40.576161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:26:40.576161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:26:40.584942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-7a1e2432-797e-4d7f-8945-63cfa1553a5e service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:40.585620 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-7a1e2432-797e-4d7f-8945-63cfa1553a5e service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:40.611359 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-7a1e2432-797e-4d7f-8945-63cfa1553a5e service nova] Creating event network-changed:965a8c13-7f18-4e6d-92f2-16c7c866bcfd for instance 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 on hv-cinder-79128 May 28 14:26:40.616881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-7a1e2432-797e-4d7f-8945-63cfa1553a5e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129042 May 28 14:26:40.617795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 284/558] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:26:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:26:40.624462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fc32d66c-54eb-471f-8e41-200b027650bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:40.625586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fc32d66c-54eb-471f-8e41-200b027650bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:40.634322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fc32d66c-54eb-471f-8e41-200b027650bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:40.635094 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fc32d66c-54eb-471f-8e41-200b027650bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:40.636296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fc32d66c-54eb-471f-8e41-200b027650bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:40.637070 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fc32d66c-54eb-471f-8e41-200b027650bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:40.647156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-abde60ce-7947-4cfe-9369-fac09c801318 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:40.657326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-abde60ce-7947-4cfe-9369-fac09c801318 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.290560 May 28 14:26:40.672484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 275/559] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:40 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:40.960942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fc32d66c-54eb-471f-8e41-200b027650bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:40.970758 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fc32d66c-54eb-471f-8e41-200b027650bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.351147 May 28 14:26:40.971546 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 285/560] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:40 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:41.504625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:41.505233 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:41.512582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:41.513042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:41.513812 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:41.514282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:41.673934 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ababa986-6dd6-44c2-b731-6b8cb55e40ab tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:41.674664 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ababa986-6dd6-44c2-b731-6b8cb55e40ab tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:41.682742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ababa986-6dd6-44c2-b731-6b8cb55e40ab tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:41.683529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ababa986-6dd6-44c2-b731-6b8cb55e40ab tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:41.685115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ababa986-6dd6-44c2-b731-6b8cb55e40ab tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:41.686023 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ababa986-6dd6-44c2-b731-6b8cb55e40ab tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:41.741154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:41.751302 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:41.752862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:41.754102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b2d02427-af98-40f7-87c8-2c85f61490ba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.253414 May 28 14:26:41.754657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 276/561] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:41 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:41.987652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:41.988569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:41.997611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:41.998718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:41.999708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:42.000268 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:42.085298 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ababa986-6dd6-44c2-b731-6b8cb55e40ab tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:42.092083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ababa986-6dd6-44c2-b731-6b8cb55e40ab tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.421645 May 28 14:26:42.102317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 286/562] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:41 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:42.217298 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:42.226023 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.242146 May 28 14:26:42.226608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 277/563] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:41 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:42.771772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:42.772351 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:42.780507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:42.781039 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:42.782116 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:42.782641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:43.007925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:43.020201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:43.021748 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:43.022966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.255176 May 28 14:26:43.023597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 287/564] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:42 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:43.110272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-228a34ec-7378-4490-8327-b58299088bf6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:43.111008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-228a34ec-7378-4490-8327-b58299088bf6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:43.118968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-228a34ec-7378-4490-8327-b58299088bf6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:43.119436 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-228a34ec-7378-4490-8327-b58299088bf6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:43.120323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-228a34ec-7378-4490-8327-b58299088bf6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:43.120836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-228a34ec-7378-4490-8327-b58299088bf6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:43.245113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-69928e93-e45d-497c-8529-9a963acced1d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:43.245695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-69928e93-e45d-497c-8529-9a963acced1d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:43.254240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69928e93-e45d-497c-8529-9a963acced1d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:43.254821 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69928e93-e45d-497c-8529-9a963acced1d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:43.255826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69928e93-e45d-497c-8529-9a963acced1d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:43.256272 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69928e93-e45d-497c-8529-9a963acced1d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:43.339018 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-228a34ec-7378-4490-8327-b58299088bf6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:43.352570 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-228a34ec-7378-4490-8327-b58299088bf6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.247285 May 28 14:26:43.353494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 278/565] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:43 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:43.499353 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-69928e93-e45d-497c-8529-9a963acced1d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:43.508052 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-69928e93-e45d-497c-8529-9a963acced1d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.268121 May 28 14:26:43.508626 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 288/566] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:43 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:44.041788 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:44.043207 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:44.057202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.057944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.058805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.059243 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.374044 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:44.377396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:44.388455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.389166 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.390027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.390520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.532320 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:44.544987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:44.546961 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:44.548420 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.511503 May 28 14:26:44.560853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 279/567] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:44 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:44.565957 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ee58901c-842d-495e-bc46-5a1d3b074ba7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:44.566809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ee58901c-842d-495e-bc46-5a1d3b074ba7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:44.575677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ee58901c-842d-495e-bc46-5a1d3b074ba7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.576219 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ee58901c-842d-495e-bc46-5a1d3b074ba7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.577238 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ee58901c-842d-495e-bc46-5a1d3b074ba7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.577757 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ee58901c-842d-495e-bc46-5a1d3b074ba7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.668398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:44.677066 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.311037 May 28 14:26:44.677796 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 289/568] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:44 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:44.834871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ee58901c-842d-495e-bc46-5a1d3b074ba7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:44.843476 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ee58901c-842d-495e-bc46-5a1d3b074ba7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.281235 May 28 14:26:44.844266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 280/569] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:44 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:45.567965 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:45.568662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:45.576853 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:45.577305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:45.578101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:45.578576 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:45.696456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:45.703240 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:45.705613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:45.706073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:45.706861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:45.707298 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:45.896106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:45.909274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:45.910877 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:45.912083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.348296 May 28 14:26:45.912995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 290/570] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:45 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:45.917569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ffd30142-7cbf-4f1a-89ce-df011cb32112 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:45.918192 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ffd30142-7cbf-4f1a-89ce-df011cb32112 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:45.926075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ffd30142-7cbf-4f1a-89ce-df011cb32112 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:45.926537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ffd30142-7cbf-4f1a-89ce-df011cb32112 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:45.927335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ffd30142-7cbf-4f1a-89ce-df011cb32112 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:45.927820 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ffd30142-7cbf-4f1a-89ce-df011cb32112 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:45.953353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:45.976100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.284331 May 28 14:26:45.982884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 281/571] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:45 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:46.154491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ffd30142-7cbf-4f1a-89ce-df011cb32112 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:46.163823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ffd30142-7cbf-4f1a-89ce-df011cb32112 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.249635 May 28 14:26:46.164399 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 291/572] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:45 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:46.246659 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cbc6f2a0-dc9a-4134-a859-265a109da5d5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d488690a-e115-4729-a105-04815f6001e7", "device": "/dev/sdb"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:46.248849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cbc6f2a0-dc9a-4134-a859-265a109da5d5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:46.256432 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cbc6f2a0-dc9a-4134-a859-265a109da5d5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:46.256883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cbc6f2a0-dc9a-4134-a859-265a109da5d5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:46.257666 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cbc6f2a0-dc9a-4134-a859-265a109da5d5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:46.258103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cbc6f2a0-dc9a-4134-a859-265a109da5d5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:46.931122 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:46.931780 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:46.945586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:46.945586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:46.945586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:46.945586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:47.160129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:47.170265 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:47.172014 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:47.173357 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-06280e3f-d555-4202-9011-5834735f5fd3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.246198 May 28 14:26:47.174377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 292/573] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:46 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:26:47.179062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0068499d-b9b5-410d-bd5a-9129f5a94604 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:47.187854 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0068499d-b9b5-410d-bd5a-9129f5a94604 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:47.188260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0068499d-b9b5-410d-bd5a-9129f5a94604 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:47.188850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0068499d-b9b5-410d-bd5a-9129f5a94604 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:47.189761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0068499d-b9b5-410d-bd5a-9129f5a94604 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:47.190321 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0068499d-b9b5-410d-bd5a-9129f5a94604 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:47.396510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0068499d-b9b5-410d-bd5a-9129f5a94604 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:47.406166 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0068499d-b9b5-410d-bd5a-9129f5a94604 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.230558 May 28 14:26:47.406932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 293/574] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:47 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:47.414396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0e06b805-69a4-4bb3-b802-8304c0d3dcff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:47.415269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0e06b805-69a4-4bb3-b802-8304c0d3dcff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:47.423498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0e06b805-69a4-4bb3-b802-8304c0d3dcff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:47.424086 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0e06b805-69a4-4bb3-b802-8304c0d3dcff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:47.424987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0e06b805-69a4-4bb3-b802-8304c0d3dcff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:47.425526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0e06b805-69a4-4bb3-b802-8304c0d3dcff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:47.637609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0e06b805-69a4-4bb3-b802-8304c0d3dcff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:47.646959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0e06b805-69a4-4bb3-b802-8304c0d3dcff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.236275 May 28 14:26:47.656533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 294/575] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:47 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:48.192374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:48.193099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:48.200182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:48.203659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:48.203659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:48.203659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:48.440015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:48.452498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:48.454448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:48.455874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c0527c8a-6a48-4e23-a617-f34b4bed9690 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.267290 May 28 14:26:48.467062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 295/576] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:48 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:26:48.472057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fffb4262-3775-4761-9318-395cdfe0ae56 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:48.472685 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fffb4262-3775-4761-9318-395cdfe0ae56 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:48.480679 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fffb4262-3775-4761-9318-395cdfe0ae56 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:48.481144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fffb4262-3775-4761-9318-395cdfe0ae56 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:48.481938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fffb4262-3775-4761-9318-395cdfe0ae56 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:48.482383 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fffb4262-3775-4761-9318-395cdfe0ae56 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:48.699840 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fffb4262-3775-4761-9318-395cdfe0ae56 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:48.708289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fffb4262-3775-4761-9318-395cdfe0ae56 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.240223 May 28 14:26:48.709073 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 296/577] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:48 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:48.713473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-69ea52dc-3873-4749-a88d-27262d3f0a41 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:48.714092 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-69ea52dc-3873-4749-a88d-27262d3f0a41 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:48.723404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69ea52dc-3873-4749-a88d-27262d3f0a41 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:48.723899 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69ea52dc-3873-4749-a88d-27262d3f0a41 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:48.724833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69ea52dc-3873-4749-a88d-27262d3f0a41 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:48.725281 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69ea52dc-3873-4749-a88d-27262d3f0a41 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:48.956447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-69ea52dc-3873-4749-a88d-27262d3f0a41 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:48.965163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-69ea52dc-3873-4749-a88d-27262d3f0a41 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.255182 May 28 14:26:48.965734 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 297/578] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:48 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:49.223685 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-162292769", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1591401235", "security_groups": [{"name": "tempest-secgroup-smoke-2127224596"}], "block_device_mapping_v2": [{"uuid": "8b8c8743-330a-4c8c-90ce-f3a34bc1eff0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "89b0ce92-0695-466c-b1ce-9a354ecba633"}]}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:49.503962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] validate_networks() for [('89b0ce92-0695-466c-b1ce-9a354ecba633', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:26:50.126020 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:26:50.126545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:26:50.127088 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:26:50.127613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:26:50.128078 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:26:50.138005 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:50.138600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:50.139635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:50.140166 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:50.162457 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for project c6d2d25991f04f00a48394ddbeec688e. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:26:50.167250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for user 75fb81f5f54947be9db03d07ad8d6ebb and project c6d2d25991f04f00a48394ddbeec688e. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:26:50.290592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:26:50.293430 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b8c8743-330a-4c8c-90ce-f3a34bc1eff0',volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:26:51.018202 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.798176 May 28 14:26:51.018857 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 298/579] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:26:49 2021] POST /compute/v2.1/servers => generated 406 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 14:26:51.025753 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:51.025753 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:51.032317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:51.032775 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:51.033567 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:51.034009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:51.256485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:51.265324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:51.269564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:51.269564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f032dde7-4d76-42ad-a295-83a3e1aa3978 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.248213 May 28 14:26:51.269564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 299/580] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:51 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:51.273702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:51.274319 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:51.281532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:51.282025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:51.282917 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:51.283364 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:51.496904 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:51.507030 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.237357 May 28 14:26:51.507816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 300/581] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:51 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:51.518272 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:51.519440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:51.527537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:51.528107 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:51.529030 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:51.529559 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:51.742582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:51.751157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.241839 May 28 14:26:51.751749 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 301/582] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:51 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:51.756009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6f03976a-af7a-41a8-a35c-db7e50d4e6a3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:51.756628 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6f03976a-af7a-41a8-a35c-db7e50d4e6a3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:51.825443 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6f03976a-af7a-41a8-a35c-db7e50d4e6a3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:51.832928 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6f03976a-af7a-41a8-a35c-db7e50d4e6a3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1094 microversion: 2.1 time: 0.080215 May 28 14:26:51.833504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 302/583] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:51 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:52.286393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:52.286914 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:52.294837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:52.295290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:52.296108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:52.296549 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:52.569806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:52.579488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:52.581102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:52.582270 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1f1d21e6-4c12-40d8-8920-0164eb031d49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.299871 May 28 14:26:52.582827 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 303/584] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:52 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:26:52.587132 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4da63001-4fe9-48fa-9881-5e46391d0978 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:52.587815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4da63001-4fe9-48fa-9881-5e46391d0978 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:52.595016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4da63001-4fe9-48fa-9881-5e46391d0978 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:52.595475 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4da63001-4fe9-48fa-9881-5e46391d0978 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:52.596321 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4da63001-4fe9-48fa-9881-5e46391d0978 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:52.596851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4da63001-4fe9-48fa-9881-5e46391d0978 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:52.801994 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4da63001-4fe9-48fa-9881-5e46391d0978 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:52.811677 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4da63001-4fe9-48fa-9881-5e46391d0978 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.227737 May 28 14:26:52.820775 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 304/585] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:52 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:52.822259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f939ff48-2967-4c1e-9a08-1865c80808fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:52.822868 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f939ff48-2967-4c1e-9a08-1865c80808fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:52.830565 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f939ff48-2967-4c1e-9a08-1865c80808fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:52.831024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f939ff48-2967-4c1e-9a08-1865c80808fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:52.831871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f939ff48-2967-4c1e-9a08-1865c80808fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:52.832314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f939ff48-2967-4c1e-9a08-1865c80808fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:53.031184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f939ff48-2967-4c1e-9a08-1865c80808fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:53.039577 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f939ff48-2967-4c1e-9a08-1865c80808fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.220823 May 28 14:26:53.040170 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 305/586] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:52 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:53.045079 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fea62e3b-8b1f-488b-82c8-22787b4a374d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:53.045719 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fea62e3b-8b1f-488b-82c8-22787b4a374d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:53.052703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fea62e3b-8b1f-488b-82c8-22787b4a374d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:53.053178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fea62e3b-8b1f-488b-82c8-22787b4a374d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:53.053941 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fea62e3b-8b1f-488b-82c8-22787b4a374d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:53.054385 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fea62e3b-8b1f-488b-82c8-22787b4a374d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:53.170093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fea62e3b-8b1f-488b-82c8-22787b4a374d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:53.178422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fea62e3b-8b1f-488b-82c8-22787b4a374d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1144 microversion: 2.1 time: 0.137277 May 28 14:26:53.181987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 306/587] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:53 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1144 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:53.600504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:53.601171 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:53.608512 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:53.608973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:53.609754 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:53.610232 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:53.810279 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:53.819216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:53.820866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:53.822007 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-206227b2-922d-4c7f-aa3c-e1b138a324a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.225287 May 28 14:26:53.822711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 307/588] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:53 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:26:53.828501 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:53.829131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:53.837608 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:53.838078 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:53.839277 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:53.840417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:54.037698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:54.045934 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.221315 May 28 14:26:54.046502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 308/589] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:53 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:54.055589 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:54.056209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:54.063923 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:54.064321 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:54.065088 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:54.065527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:54.266558 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:54.274707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.222529 May 28 14:26:54.275266 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 309/590] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:54 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:54.279597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f1f4f108-7e4f-499a-a456-4ed512be0d0a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:54.280171 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f1f4f108-7e4f-499a-a456-4ed512be0d0a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:54.287541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f1f4f108-7e4f-499a-a456-4ed512be0d0a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:54.288024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f1f4f108-7e4f-499a-a456-4ed512be0d0a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:54.288804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f1f4f108-7e4f-499a-a456-4ed512be0d0a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:54.289241 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f1f4f108-7e4f-499a-a456-4ed512be0d0a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:54.406162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f1f4f108-7e4f-499a-a456-4ed512be0d0a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:54.414415 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f1f4f108-7e4f-499a-a456-4ed512be0d0a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1144 microversion: 2.1 time: 0.138158 May 28 14:26:54.414980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 310/591] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:54 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1144 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:54.841896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:54.842669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:54.850117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:54.850581 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:54.851374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:54.851849 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:55.405723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:55.414721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:55.417087 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:55.418561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.581271 May 28 14:26:55.424816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 311/592] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:54 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:26:55.426856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7387df35-13fa-453f-b7ea-eee60b388c94 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:55.427595 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7387df35-13fa-453f-b7ea-eee60b388c94 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:55.436751 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7387df35-13fa-453f-b7ea-eee60b388c94 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:55.443800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7387df35-13fa-453f-b7ea-eee60b388c94 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:55.443800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7387df35-13fa-453f-b7ea-eee60b388c94 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:55.443800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7387df35-13fa-453f-b7ea-eee60b388c94 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:55.803580 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cbc6f2a0-dc9a-4134-a859-265a109da5d5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "POST /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.561506 May 28 14:26:55.804225 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 282/593] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:26:46 2021] POST /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be/os-volume_attachments => generated 194 bytes in 9563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:26:55.810342 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:55.812185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:55.821228 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:55.821736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:55.822451 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:55.822921 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:56.056139 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7387df35-13fa-453f-b7ea-eee60b388c94 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:56.064679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:56.068527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7387df35-13fa-453f-b7ea-eee60b388c94 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.646882 May 28 14:26:56.074727 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.269223 May 28 14:26:56.075047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 312/594] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:55 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:56.089938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 283/595] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:55 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:56.090065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7db5cbc5-2fad-4916-885b-47b179453b29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:56.090065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7db5cbc5-2fad-4916-885b-47b179453b29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:56.097294 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7db5cbc5-2fad-4916-885b-47b179453b29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:56.097989 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7db5cbc5-2fad-4916-885b-47b179453b29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:56.099077 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7db5cbc5-2fad-4916-885b-47b179453b29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:56.099918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7db5cbc5-2fad-4916-885b-47b179453b29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:56.374416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7db5cbc5-2fad-4916-885b-47b179453b29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:56.383048 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7db5cbc5-2fad-4916-885b-47b179453b29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1192 microversion: 2.1 time: 0.306812 May 28 14:26:56.384091 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 313/596] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:56 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1192 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:56.437128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:56.438002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:56.447934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:56.448401 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:56.449257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:56.449714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:56.665626 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:56.674832 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:56.676520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:56.677656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4485f46b-7f37-4cb9-b366-8a3adf601f2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.244704 May 28 14:26:56.678246 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 284/597] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:56 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:57.085182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-48586e30-2149-439b-b3b8-9f73d0c05848 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:57.085947 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-48586e30-2149-439b-b3b8-9f73d0c05848 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:57.091769 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dacca39b-e712-4ad3-92e3-c711836e7fe6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:57.092607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dacca39b-e712-4ad3-92e3-c711836e7fe6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:57.094551 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-48586e30-2149-439b-b3b8-9f73d0c05848 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.095122 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-48586e30-2149-439b-b3b8-9f73d0c05848 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.096203 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-48586e30-2149-439b-b3b8-9f73d0c05848 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.096769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-48586e30-2149-439b-b3b8-9f73d0c05848 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.100377 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dacca39b-e712-4ad3-92e3-c711836e7fe6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.100849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dacca39b-e712-4ad3-92e3-c711836e7fe6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.101645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dacca39b-e712-4ad3-92e3-c711836e7fe6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.114541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dacca39b-e712-4ad3-92e3-c711836e7fe6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.379989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dacca39b-e712-4ad3-92e3-c711836e7fe6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:57.393558 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dacca39b-e712-4ad3-92e3-c711836e7fe6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.303247 May 28 14:26:57.394005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 285/598] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:57 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:57.398875 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-94fe43c0-7c07-428b-9c36-2ae8847ba9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4", "tag": "164fd7c8-7a57-4285-93ef-c3fdabceb8be"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:57.402753 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:26:57.402753 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:26:57.422749 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-94fe43c0-7c07-428b-9c36-2ae8847ba9fe service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.423828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-94fe43c0-7c07-428b-9c36-2ae8847ba9fe service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.445215 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-94fe43c0-7c07-428b-9c36-2ae8847ba9fe service nova] Creating event network-changed:164fd7c8-7a57-4285-93ef-c3fdabceb8be for instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 on hv-cinder-79128 May 28 14:26:57.451285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-94fe43c0-7c07-428b-9c36-2ae8847ba9fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055481 May 28 14:26:57.453304 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 286/599] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:26:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:26:57.458886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:57.460728 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:57.469603 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.470239 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.471540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.472532 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.746433 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:57.765478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1210 microversion: 2.1 time: 0.300922 May 28 14:26:57.765478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 287/600] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:57 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1210 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:57.765478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:57.765478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:57.769256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.769723 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.770573 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:57.771072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:57.856932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-48586e30-2149-439b-b3b8-9f73d0c05848 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:57.866711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-48586e30-2149-439b-b3b8-9f73d0c05848 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.785238 May 28 14:26:57.878776 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 314/601] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:57 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:57.999029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:58.008577 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:58.010177 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:58.011987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1744 microversion: 2.20 time: 0.254581 May 28 14:26:58.012557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 288/602] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:57 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1744 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:26:58.409671 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-de21b0d0-c9f4-4b76-96c6-c845d210be87 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:58.410419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-de21b0d0-c9f4-4b76-96c6-c845d210be87 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:58.418969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de21b0d0-c9f4-4b76-96c6-c845d210be87 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:58.419432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de21b0d0-c9f4-4b76-96c6-c845d210be87 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:58.420264 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de21b0d0-c9f4-4b76-96c6-c845d210be87 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:58.420716 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de21b0d0-c9f4-4b76-96c6-c845d210be87 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:58.772559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c64526f6-c308-48f2-a1ee-8e8fee089534 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:58.785113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c64526f6-c308-48f2-a1ee-8e8fee089534 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:58.785113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c64526f6-c308-48f2-a1ee-8e8fee089534 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:58.785113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c64526f6-c308-48f2-a1ee-8e8fee089534 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:58.785113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c64526f6-c308-48f2-a1ee-8e8fee089534 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:58.785607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c64526f6-c308-48f2-a1ee-8e8fee089534 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:58.899648 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c64526f6-c308-48f2-a1ee-8e8fee089534 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:58.908723 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c64526f6-c308-48f2-a1ee-8e8fee089534 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1210 microversion: 2.1 time: 0.140073 May 28 14:26:58.909309 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 289/603] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:58 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1210 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:26:58.912832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-de21b0d0-c9f4-4b76-96c6-c845d210be87 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:58.922495 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:58.922495 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:58.924531 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-de21b0d0-c9f4-4b76-96c6-c845d210be87 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.518699 May 28 14:26:58.924708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:58.925168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:58.929418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 315/604] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:58 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:58.929546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:58.929546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:59.031821 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:59.032775 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:59.040738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:59.041307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:59.042202 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:59.042772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:59.147422 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:59.155952 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.245380 May 28 14:26:59.156621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 290/605] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:58 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:26:59.626457 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:59.636250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:59.638529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:26:59.639969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1744 microversion: 2.20 time: 0.613338 May 28 14:26:59.640732 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 316/606] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:26:59 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1744 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:26:59.862917 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-2d744264-e956-432b-a027-0ccd163549bd req-ff00d10c-294e-4bda-9472-7d2bc69a5be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c36e73b-e6ab-4203-ada8-e971693460e2", "name": "network-vif-plugged", "status": "completed", "tag": "c2872b93-4077-4bc0-8619-140f73de2a3a"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:26:59.864723 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:26:59.864723 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:26:59.875478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-2d744264-e956-432b-a027-0ccd163549bd req-ff00d10c-294e-4bda-9472-7d2bc69a5be5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:59.878712 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-2d744264-e956-432b-a027-0ccd163549bd req-ff00d10c-294e-4bda-9472-7d2bc69a5be5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:59.895572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-2d744264-e956-432b-a027-0ccd163549bd req-ff00d10c-294e-4bda-9472-7d2bc69a5be5 service nova] Creating event network-vif-plugged:c2872b93-4077-4bc0-8619-140f73de2a3a for instance 2c36e73b-e6ab-4203-ada8-e971693460e2 on hv-cinder-79128 May 28 14:26:59.902006 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-2d744264-e956-432b-a027-0ccd163549bd req-ff00d10c-294e-4bda-9472-7d2bc69a5be5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179866 May 28 14:26:59.902930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 291/607] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:26:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:26:59.925324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-417733ea-c3b8-4890-95fd-d0d96502d9fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:59.926074 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-417733ea-c3b8-4890-95fd-d0d96502d9fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:59.933794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-417733ea-c3b8-4890-95fd-d0d96502d9fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:59.934347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-417733ea-c3b8-4890-95fd-d0d96502d9fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:59.936874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-417733ea-c3b8-4890-95fd-d0d96502d9fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:59.936874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-417733ea-c3b8-4890-95fd-d0d96502d9fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:59.942833 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-47bf58fa-247f-4534-a3bd-be0fdf80c643 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:26:59.944056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-47bf58fa-247f-4534-a3bd-be0fdf80c643 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:26:59.952206 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47bf58fa-247f-4534-a3bd-be0fdf80c643 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:59.958439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47bf58fa-247f-4534-a3bd-be0fdf80c643 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:59.958439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47bf58fa-247f-4534-a3bd-be0fdf80c643 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:59.958439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47bf58fa-247f-4534-a3bd-be0fdf80c643 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:00.165883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-47bf58fa-247f-4534-a3bd-be0fdf80c643 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:00.175474 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-47bf58fa-247f-4534-a3bd-be0fdf80c643 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.236627 May 28 14:27:00.176110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 292/608] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:59 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:00.181656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:00.181656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:00.188483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:00.188937 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:00.189720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:00.190157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:00.412269 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:00.420704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.243598 May 28 14:27:00.421478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 293/609] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:00 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:00.421601 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-417733ea-c3b8-4890-95fd-d0d96502d9fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:00.430300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-417733ea-c3b8-4890-95fd-d0d96502d9fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1278 microversion: 2.1 time: 0.508524 May 28 14:27:00.430926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 317/610] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:26:59 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1278 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:00.658483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:00.659251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:00.667200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:00.668075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:00.669125 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:00.669708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:00.886795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:00.896765 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:00.898316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:00.899459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f7555d83-3569-4181-bea0-fe9a030f41ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1744 microversion: 2.20 time: 0.244856 May 28 14:27:00.900054 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 294/611] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:00 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1744 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:01.012330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-9fee27e7-9878-488b-b083-e3e1ded13519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be0a35c-b0fe-4a26-b785-3e16aa182171", "tag": "4b79b510-d52c-4720-bf56-28c541fff0b4"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:01.013909 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:27:01.013909 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:27:01.030252 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-9fee27e7-9878-488b-b083-e3e1ded13519 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.030252 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-9fee27e7-9878-488b-b083-e3e1ded13519 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:01.044742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-9fee27e7-9878-488b-b083-e3e1ded13519 service nova] Creating event network-changed:4b79b510-d52c-4720-bf56-28c541fff0b4 for instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 on hv-cinder-79128 May 28 14:27:01.049592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-9fee27e7-9878-488b-b083-e3e1ded13519 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040964 May 28 14:27:01.050260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 318/612] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:27:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:27:01.191899 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c3c0828f-3f11-4f21-8db6-da038548a1bc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:01.192551 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c3c0828f-3f11-4f21-8db6-da038548a1bc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:01.199916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c3c0828f-3f11-4f21-8db6-da038548a1bc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.200369 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c3c0828f-3f11-4f21-8db6-da038548a1bc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:01.201578 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c3c0828f-3f11-4f21-8db6-da038548a1bc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.201757 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c3c0828f-3f11-4f21-8db6-da038548a1bc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:01.414456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c3c0828f-3f11-4f21-8db6-da038548a1bc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:01.425484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c3c0828f-3f11-4f21-8db6-da038548a1bc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.235675 May 28 14:27:01.426100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 295/613] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:01 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:01.437922 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-84a18e26-f686-4f73-8a23-4b5cb57093f7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:01.438637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-84a18e26-f686-4f73-8a23-4b5cb57093f7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:01.446101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9742d2c5-da69-495d-a3f9-dd86428b869e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:01.447000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9742d2c5-da69-495d-a3f9-dd86428b869e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:01.455231 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9742d2c5-da69-495d-a3f9-dd86428b869e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.455981 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9742d2c5-da69-495d-a3f9-dd86428b869e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:01.456944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9742d2c5-da69-495d-a3f9-dd86428b869e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.457543 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9742d2c5-da69-495d-a3f9-dd86428b869e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:01.458273 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-84a18e26-f686-4f73-8a23-4b5cb57093f7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.458749 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-84a18e26-f686-4f73-8a23-4b5cb57093f7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:01.459586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-84a18e26-f686-4f73-8a23-4b5cb57093f7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.460047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-84a18e26-f686-4f73-8a23-4b5cb57093f7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:01.719301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9742d2c5-da69-495d-a3f9-dd86428b869e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:01.729042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9742d2c5-da69-495d-a3f9-dd86428b869e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1278 microversion: 2.1 time: 0.286623 May 28 14:27:01.730398 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 296/614] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:01 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:01.889830 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-84a18e26-f686-4f73-8a23-4b5cb57093f7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:01.898327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-84a18e26-f686-4f73-8a23-4b5cb57093f7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.464441 May 28 14:27:01.898996 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 319/615] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:01 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:01.918148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:01.918776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:01.926156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.926619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:01.927638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:01.928083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:02.136654 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:02.146054 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:02.147612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:02.148766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d6085c5b-d280-410b-b95f-ee6cb56cf144 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1744 microversion: 2.20 time: 0.234794 May 28 14:27:02.149339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 297/616] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:01 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1744 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:02.442106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-30642616-bbcc-4b97-a397-36ea6e615812 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:02.442726 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-30642616-bbcc-4b97-a397-36ea6e615812 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:02.450785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30642616-bbcc-4b97-a397-36ea6e615812 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:02.451267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30642616-bbcc-4b97-a397-36ea6e615812 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:02.452088 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30642616-bbcc-4b97-a397-36ea6e615812 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:02.452530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30642616-bbcc-4b97-a397-36ea6e615812 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:02.660240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-30642616-bbcc-4b97-a397-36ea6e615812 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:02.669514 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-30642616-bbcc-4b97-a397-36ea6e615812 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.231113 May 28 14:27:02.671105 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 320/617] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:02 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:02.748028 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:02.748628 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:02.756081 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:02.756537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:02.757323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:02.757767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:02.915841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d1c5e38f-d8c2-4454-b673-be3b816d02bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:02.916498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d1c5e38f-d8c2-4454-b673-be3b816d02bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:02.924849 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d1c5e38f-d8c2-4454-b673-be3b816d02bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:02.925780 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d1c5e38f-d8c2-4454-b673-be3b816d02bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:02.929377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d1c5e38f-d8c2-4454-b673-be3b816d02bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:02.929377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d1c5e38f-d8c2-4454-b673-be3b816d02bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:02.962490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:02.971347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1278 microversion: 2.1 time: 0.227880 May 28 14:27:02.971949 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 298/618] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:02 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1278 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:03.126079 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d1c5e38f-d8c2-4454-b673-be3b816d02bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:03.134366 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d1c5e38f-d8c2-4454-b673-be3b816d02bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.222252 May 28 14:27:03.134937 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 321/619] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:02 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:03.170270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:03.170878 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:03.178347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:03.181325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:03.181325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:03.181325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:03.376083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:03.384960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:03.387003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:03.388181 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ca61cac9-87d6-490c-81c5-f0ad896f23db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1744 microversion: 2.20 time: 0.222527 May 28 14:27:03.388744 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 299/620] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:03 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:03.686938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:03.687582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:03.694858 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:03.695316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:03.696165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:03.696610 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:03.912436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:03.921358 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.238079 May 28 14:27:03.921934 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 322/621] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:03 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:03.988827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-31b7514f-115b-4412-9a6d-7860471d60cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:03.989446 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-31b7514f-115b-4412-9a6d-7860471d60cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:03.997784 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-31b7514f-115b-4412-9a6d-7860471d60cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:03.998591 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-31b7514f-115b-4412-9a6d-7860471d60cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:03.999391 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-31b7514f-115b-4412-9a6d-7860471d60cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:03.999863 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-31b7514f-115b-4412-9a6d-7860471d60cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:04.152609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:04.153195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:04.160996 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:04.161452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:04.162280 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:04.162702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:04.278560 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-31b7514f-115b-4412-9a6d-7860471d60cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:04.287000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-31b7514f-115b-4412-9a6d-7860471d60cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1278 microversion: 2.1 time: 0.301855 May 28 14:27:04.288094 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 300/622] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:03 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1278 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:04.358770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:04.366884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.218830 May 28 14:27:04.367447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 323/623] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:04 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:04.406285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:04.406837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:04.414687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:04.415148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:04.416049 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:04.416548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:04.616434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:04.626180 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:04.627813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:04.628959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1d001800-6559-4d61-9374-1dfe4419e7ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1744 microversion: 2.20 time: 0.226551 May 28 14:27:04.638503 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 301/624] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:04 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:04.939198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:04.940032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:04.948829 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:04.949810 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:04.950951 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:04.951409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:05.155690 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:05.164834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.229470 May 28 14:27:05.165408 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 324/625] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:04 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:05.302432 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c6e56e72-4873-49e9-ac5a-9fc438204990 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:05.303058 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c6e56e72-4873-49e9-ac5a-9fc438204990 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:05.310501 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c6e56e72-4873-49e9-ac5a-9fc438204990 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:05.310989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c6e56e72-4873-49e9-ac5a-9fc438204990 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:05.311822 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c6e56e72-4873-49e9-ac5a-9fc438204990 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:05.312269 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c6e56e72-4873-49e9-ac5a-9fc438204990 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:05.384389 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4a52e780-b6e1-48c1-a050-65d73b853dfc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:05.384933 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4a52e780-b6e1-48c1-a050-65d73b853dfc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:05.392395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4a52e780-b6e1-48c1-a050-65d73b853dfc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:05.392881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4a52e780-b6e1-48c1-a050-65d73b853dfc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:05.393651 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4a52e780-b6e1-48c1-a050-65d73b853dfc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:05.394101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4a52e780-b6e1-48c1-a050-65d73b853dfc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:05.518450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c6e56e72-4873-49e9-ac5a-9fc438204990 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:05.527186 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c6e56e72-4873-49e9-ac5a-9fc438204990 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1278 microversion: 2.1 time: 0.227853 May 28 14:27:05.527803 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 302/626] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:05 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1278 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:05.598713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4a52e780-b6e1-48c1-a050-65d73b853dfc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:05.606885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4a52e780-b6e1-48c1-a050-65d73b853dfc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.226297 May 28 14:27:05.607460 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 325/627] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:05 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:05.648180 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:05.648829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:05.657430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:05.657886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:05.658737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:05.659244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:05.725111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-a13876a3-0614-4ec6-bad8-c3fdc163c36c req-0a237b45-2173-43b1-8d95-a6fedadfb0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eac2abf-26a1-4d1d-84ed-ac16a83ef646", "name": "network-vif-plugged", "status": "completed", "tag": "965a8c13-7f18-4e6d-92f2-16c7c866bcfd"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:05.726872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:27:05.726872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:27:05.735435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-a13876a3-0614-4ec6-bad8-c3fdc163c36c req-0a237b45-2173-43b1-8d95-a6fedadfb0d5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:05.736037 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-a13876a3-0614-4ec6-bad8-c3fdc163c36c req-0a237b45-2173-43b1-8d95-a6fedadfb0d5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:05.752672 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-a13876a3-0614-4ec6-bad8-c3fdc163c36c req-0a237b45-2173-43b1-8d95-a6fedadfb0d5 service nova] Creating event network-vif-plugged:965a8c13-7f18-4e6d-92f2-16c7c866bcfd for instance 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 on hv-cinder-79128 May 28 14:27:05.757528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-a13876a3-0614-4ec6-bad8-c3fdc163c36c req-0a237b45-2173-43b1-8d95-a6fedadfb0d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036215 May 28 14:27:05.758127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 326/628] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:27:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:27:05.893449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:05.902319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:05.903984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:05.905142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-04badf5d-4363-47f9-bedd-b981cc90d5cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1744 microversion: 2.20 time: 0.260986 May 28 14:27:05.905713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 303/629] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:05 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1744 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:06.183343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-de6fde93-3f77-4282-99ab-14000107fc06 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:06.183985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-de6fde93-3f77-4282-99ab-14000107fc06 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:06.191350 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de6fde93-3f77-4282-99ab-14000107fc06 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:06.191848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de6fde93-3f77-4282-99ab-14000107fc06 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:06.192632 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de6fde93-3f77-4282-99ab-14000107fc06 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:06.193075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de6fde93-3f77-4282-99ab-14000107fc06 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:06.490440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-de6fde93-3f77-4282-99ab-14000107fc06 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:06.500413 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-de6fde93-3f77-4282-99ab-14000107fc06 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.321776 May 28 14:27:06.501013 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 327/630] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:06 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:06.550374 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:06.550982 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:06.558961 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:06.559943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:06.560914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:06.561366 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:06.624604 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:06.625227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:06.632943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:06.633569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:06.634511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:06.634965 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:06.777396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:06.786825 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1278 microversion: 2.1 time: 0.240072 May 28 14:27:06.787404 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 304/631] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:06 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:06.849076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:06.858888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.238625 May 28 14:27:06.860348 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 328/632] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:06 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:06.924737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:06.925410 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:06.932704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:06.933194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:06.933966 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:06.934439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:07.143508 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:07.153415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:07.154950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:07.156143 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-54f9b5f1-aef0-4598-83ea-0d7a5187864a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.235331 May 28 14:27:07.156692 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 305/633] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:06 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:07.519648 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-062284ca-94e9-4b4f-a28c-b88aa8756a27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:07.520451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-062284ca-94e9-4b4f-a28c-b88aa8756a27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:07.528593 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-062284ca-94e9-4b4f-a28c-b88aa8756a27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:07.529141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-062284ca-94e9-4b4f-a28c-b88aa8756a27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:07.529940 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-062284ca-94e9-4b4f-a28c-b88aa8756a27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:07.530416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-062284ca-94e9-4b4f-a28c-b88aa8756a27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:07.821854 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7960afe0-fc0c-42a9-9cdd-924867ca9371 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:07.821854 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7960afe0-fc0c-42a9-9cdd-924867ca9371 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:07.834080 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7960afe0-fc0c-42a9-9cdd-924867ca9371 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:07.838615 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7960afe0-fc0c-42a9-9cdd-924867ca9371 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:07.841424 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7960afe0-fc0c-42a9-9cdd-924867ca9371 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:07.841900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7960afe0-fc0c-42a9-9cdd-924867ca9371 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:07.849012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-062284ca-94e9-4b4f-a28c-b88aa8756a27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:07.859370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-062284ca-94e9-4b4f-a28c-b88aa8756a27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.344195 May 28 14:27:07.860256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 329/634] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:07 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:07.864977 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-1219f453-c90e-4445-aaa5-f9364e63ac5b req-9bbd6eab-6c16-4bbf-8f20-2c60194c695e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4", "name": "network-vif-plugged", "status": "completed", "tag": "164fd7c8-7a57-4285-93ef-c3fdabceb8be"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:07.867301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:27:07.867301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:27:07.884102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-1219f453-c90e-4445-aaa5-f9364e63ac5b req-9bbd6eab-6c16-4bbf-8f20-2c60194c695e service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:07.884102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-1219f453-c90e-4445-aaa5-f9364e63ac5b req-9bbd6eab-6c16-4bbf-8f20-2c60194c695e service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:07.895221 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-1219f453-c90e-4445-aaa5-f9364e63ac5b req-9bbd6eab-6c16-4bbf-8f20-2c60194c695e service nova] Creating event network-vif-plugged:164fd7c8-7a57-4285-93ef-c3fdabceb8be for instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 on hv-cinder-79128 May 28 14:27:07.900704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-1219f453-c90e-4445-aaa5-f9364e63ac5b req-9bbd6eab-6c16-4bbf-8f20-2c60194c695e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 May 28 14:27:07.901738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 330/635] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:27:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:27:07.909576 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:07.910564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:07.919048 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:07.919503 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:07.920352 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:07.920793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:08.113336 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7960afe0-fc0c-42a9-9cdd-924867ca9371 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:08.123441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7960afe0-fc0c-42a9-9cdd-924867ca9371 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.319893 May 28 14:27:08.124154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 306/636] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:07 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:08.170301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:08.174873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:08.175799 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:08.181789 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.276562 May 28 14:27:08.182372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 331/637] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:07 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:08.185362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:08.185821 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:08.186614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:08.187239 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:08.393725 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:08.403952 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:08.405487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:08.406639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-66804008-0b81-4afe-b384-0c4b2e619f48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.236262 May 28 14:27:08.407282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 307/638] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:08 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:08.879264 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-59d20679-a45a-4a45-9e56-188ecccca691 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:08.879264 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-59d20679-a45a-4a45-9e56-188ecccca691 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:08.888461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-59d20679-a45a-4a45-9e56-188ecccca691 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:08.889283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-59d20679-a45a-4a45-9e56-188ecccca691 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:08.890241 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-59d20679-a45a-4a45-9e56-188ecccca691 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:08.890790 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-59d20679-a45a-4a45-9e56-188ecccca691 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:09.100529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-59d20679-a45a-4a45-9e56-188ecccca691 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:09.109246 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-59d20679-a45a-4a45-9e56-188ecccca691 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.234877 May 28 14:27:09.109851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 332/639] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:08 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:09.140663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9737b1bb-c18c-4201-9c96-c30ac24498dc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:09.141264 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9737b1bb-c18c-4201-9c96-c30ac24498dc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:09.149717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9737b1bb-c18c-4201-9c96-c30ac24498dc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:09.150179 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9737b1bb-c18c-4201-9c96-c30ac24498dc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:09.150956 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9737b1bb-c18c-4201-9c96-c30ac24498dc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:09.151470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9737b1bb-c18c-4201-9c96-c30ac24498dc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:09.199052 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:09.199717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:09.207881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:09.208428 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:09.209652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:09.210346 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:09.375351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9737b1bb-c18c-4201-9c96-c30ac24498dc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:09.383833 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9737b1bb-c18c-4201-9c96-c30ac24498dc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.246925 May 28 14:27:09.387594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 308/640] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:09 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:09.428862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:09.430059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:09.438773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:09.439348 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:09.440262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:09.440930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:09.447386 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:09.456444 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.261876 May 28 14:27:09.457026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 333/641] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:09 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:09.641507 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:09.650203 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:09.652330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:09.653523 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-063ed975-d7a8-400f-8616-62a7c62647b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.230976 May 28 14:27:09.662065 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 309/642] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:09 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:10.125997 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:10.126633 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:10.134564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:10.135022 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:10.136368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:10.136814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:10.353804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:10.364264 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.241925 May 28 14:27:10.365172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 334/643] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:10 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:10.400829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5497e119-25dc-4717-ae50-9230fbcbe5ca tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:10.401506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5497e119-25dc-4717-ae50-9230fbcbe5ca tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:10.409494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5497e119-25dc-4717-ae50-9230fbcbe5ca tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:10.410063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5497e119-25dc-4717-ae50-9230fbcbe5ca tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:10.410959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5497e119-25dc-4717-ae50-9230fbcbe5ca tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:10.411500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5497e119-25dc-4717-ae50-9230fbcbe5ca tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:10.478771 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:10.481681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:10.501083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:10.501541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:10.502530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:10.502984 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:10.719867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:10.721509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.247051 May 28 14:27:10.730445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 335/644] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:10 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:10.735093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:10.735885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:10.743279 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:10.743746 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:10.745621 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:10.745793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:10.791387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5497e119-25dc-4717-ae50-9230fbcbe5ca tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:10.803806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5497e119-25dc-4717-ae50-9230fbcbe5ca tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.406544 May 28 14:27:10.804381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 310/645] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:10 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:10.986650 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:10.996836 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:10.998419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:11.000115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6f136447-278e-4dd5-9fe5-908fad718609 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.268641 May 28 14:27:11.000683 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 336/646] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:10 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:11.383011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b8dca611-43bb-49f8-9faf-cc1a4e702559 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:11.384032 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b8dca611-43bb-49f8-9faf-cc1a4e702559 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:11.392021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b8dca611-43bb-49f8-9faf-cc1a4e702559 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:11.392480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b8dca611-43bb-49f8-9faf-cc1a4e702559 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:11.393278 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b8dca611-43bb-49f8-9faf-cc1a4e702559 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:11.393715 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b8dca611-43bb-49f8-9faf-cc1a4e702559 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:11.609819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b8dca611-43bb-49f8-9faf-cc1a4e702559 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:11.618624 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b8dca611-43bb-49f8-9faf-cc1a4e702559 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.240022 May 28 14:27:11.619463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 311/647] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:11 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:11.738360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:11.739013 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:11.748009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:11.748472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:11.749296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:11.749735 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:11.822014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9c31f814-d5bc-4689-b3ec-f116219585e3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:11.822638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9c31f814-d5bc-4689-b3ec-f116219585e3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:11.832622 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9c31f814-d5bc-4689-b3ec-f116219585e3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:11.833236 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9c31f814-d5bc-4689-b3ec-f116219585e3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:11.834037 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9c31f814-d5bc-4689-b3ec-f116219585e3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:11.834478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9c31f814-d5bc-4689-b3ec-f116219585e3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:11.994049 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:12.008828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.274169 May 28 14:27:12.009419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 337/648] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:11 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:12.026899 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:12.027740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:12.037316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:12.037776 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:12.038577 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:12.039052 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:12.086517 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9c31f814-d5bc-4689-b3ec-f116219585e3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:12.103726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9c31f814-d5bc-4689-b3ec-f116219585e3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.285229 May 28 14:27:12.105175 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 312/649] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:11 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:12.273572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:12.283911 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:12.285443 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:12.286646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.268098 May 28 14:27:12.287205 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 338/650] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:12 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:12.637026 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-373800a0-3543-414d-b5b6-c4329c509564 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:12.638386 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-373800a0-3543-414d-b5b6-c4329c509564 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:12.646957 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-373800a0-3543-414d-b5b6-c4329c509564 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:12.647521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-373800a0-3543-414d-b5b6-c4329c509564 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:12.648469 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-373800a0-3543-414d-b5b6-c4329c509564 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:12.648993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-373800a0-3543-414d-b5b6-c4329c509564 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:12.856258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-373800a0-3543-414d-b5b6-c4329c509564 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:12.865812 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-373800a0-3543-414d-b5b6-c4329c509564 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.232675 May 28 14:27:12.865812 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 313/651] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:12 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:13.028727 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-72190e74-bad9-4c79-bdae-e2de500667d3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:13.029400 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-72190e74-bad9-4c79-bdae-e2de500667d3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:13.036823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-72190e74-bad9-4c79-bdae-e2de500667d3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:13.037278 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-72190e74-bad9-4c79-bdae-e2de500667d3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:13.038063 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-72190e74-bad9-4c79-bdae-e2de500667d3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:13.038514 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-72190e74-bad9-4c79-bdae-e2de500667d3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:13.123035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9704d721-ec8c-4145-ac84-06b18b680f3e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:13.124043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9704d721-ec8c-4145-ac84-06b18b680f3e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:13.132020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9704d721-ec8c-4145-ac84-06b18b680f3e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:13.132472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9704d721-ec8c-4145-ac84-06b18b680f3e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:13.133259 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9704d721-ec8c-4145-ac84-06b18b680f3e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:13.133695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9704d721-ec8c-4145-ac84-06b18b680f3e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:13.271471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-72190e74-bad9-4c79-bdae-e2de500667d3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:13.281727 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-72190e74-bad9-4c79-bdae-e2de500667d3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.256759 May 28 14:27:13.282987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 339/652] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:13 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:13.305180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:13.305800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:13.317447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:13.317912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:13.318764 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:13.319393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:13.376252 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9704d721-ec8c-4145-ac84-06b18b680f3e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:13.386211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9704d721-ec8c-4145-ac84-06b18b680f3e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.267631 May 28 14:27:13.395586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 314/653] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:13 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:13.560487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:13.572051 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:13.573644 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:13.574880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.273398 May 28 14:27:13.585445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 340/654] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:13 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:13.883478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-54efd833-1663-4df1-80a5-9db80fdb1ed8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:13.886614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-54efd833-1663-4df1-80a5-9db80fdb1ed8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:13.894085 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54efd833-1663-4df1-80a5-9db80fdb1ed8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:13.894538 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54efd833-1663-4df1-80a5-9db80fdb1ed8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:13.895319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54efd833-1663-4df1-80a5-9db80fdb1ed8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:13.895810 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-54efd833-1663-4df1-80a5-9db80fdb1ed8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:14.115536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-54efd833-1663-4df1-80a5-9db80fdb1ed8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:14.127635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-54efd833-1663-4df1-80a5-9db80fdb1ed8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.247832 May 28 14:27:14.138734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 315/655] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:13 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:14.298951 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3a5335f4-edc1-45f7-a598-b779fb045640 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:14.300139 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3a5335f4-edc1-45f7-a598-b779fb045640 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:14.309556 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a5335f4-edc1-45f7-a598-b779fb045640 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:14.309934 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a5335f4-edc1-45f7-a598-b779fb045640 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:14.310783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a5335f4-edc1-45f7-a598-b779fb045640 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:14.311392 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a5335f4-edc1-45f7-a598-b779fb045640 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:14.403162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:14.403824 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:14.411491 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:14.411984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:14.412770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:14.413213 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:14.560054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3a5335f4-edc1-45f7-a598-b779fb045640 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:14.569398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3a5335f4-edc1-45f7-a598-b779fb045640 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.274150 May 28 14:27:14.580721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 341/656] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:14 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:14.599707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:14.600513 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:14.609877 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:14.610335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:14.611144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:14.611618 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:14.718152 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:14.727945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.329317 May 28 14:27:14.729205 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 316/657] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:14 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:14.835771 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:14.846604 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:14.849879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:14.851651 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.256736 May 28 14:27:14.852840 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 342/658] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:14 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:15.147176 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bca39701-e54e-4b5b-ace4-4c0b22793a02 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:15.148469 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bca39701-e54e-4b5b-ace4-4c0b22793a02 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:15.158498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bca39701-e54e-4b5b-ace4-4c0b22793a02 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:15.159284 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bca39701-e54e-4b5b-ace4-4c0b22793a02 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:15.161172 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bca39701-e54e-4b5b-ace4-4c0b22793a02 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:15.161959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bca39701-e54e-4b5b-ace4-4c0b22793a02 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:15.411896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bca39701-e54e-4b5b-ace4-4c0b22793a02 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:15.421704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bca39701-e54e-4b5b-ace4-4c0b22793a02 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.279116 May 28 14:27:15.432000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 317/659] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:15 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:15.587857 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-068e78a5-be0b-46fc-9eab-047c2030236a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:15.588527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-068e78a5-be0b-46fc-9eab-047c2030236a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:15.597347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-068e78a5-be0b-46fc-9eab-047c2030236a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:15.597810 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-068e78a5-be0b-46fc-9eab-047c2030236a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:15.598638 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-068e78a5-be0b-46fc-9eab-047c2030236a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:15.599090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-068e78a5-be0b-46fc-9eab-047c2030236a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:15.746852 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:15.747535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:15.758572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:15.765199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:15.765199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:15.765199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:15.826783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-068e78a5-be0b-46fc-9eab-047c2030236a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:15.835190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-068e78a5-be0b-46fc-9eab-047c2030236a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.251399 May 28 14:27:15.835803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 343/660] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:15 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:15.871031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:15.871669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:15.879233 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:15.879737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:15.880519 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:15.880973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:16.037563 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:16.049844 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.308055 May 28 14:27:16.050773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 318/661] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:15 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:16.130638 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:16.140963 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:16.142510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:16.144151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.277741 May 28 14:27:16.144751 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 344/662] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:15 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:16.439105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:16.439734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:16.447441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:16.448083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:16.449389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:16.449929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:16.749176 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:16.761447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.325575 May 28 14:27:16.770739 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 319/663] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:16 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:16.852431 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-328dddba-9809-4934-9209-3df4f3f8964a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:16.853064 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-328dddba-9809-4934-9209-3df4f3f8964a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:16.860510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-328dddba-9809-4934-9209-3df4f3f8964a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:16.860970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-328dddba-9809-4934-9209-3df4f3f8964a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:16.861770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-328dddba-9809-4934-9209-3df4f3f8964a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:16.862559 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-328dddba-9809-4934-9209-3df4f3f8964a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:17.070081 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-153c78ca-e578-4826-92b9-a739cffa7fb1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:17.070724 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-153c78ca-e578-4826-92b9-a739cffa7fb1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:17.084976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-153c78ca-e578-4826-92b9-a739cffa7fb1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:17.085444 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-153c78ca-e578-4826-92b9-a739cffa7fb1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:17.086253 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-153c78ca-e578-4826-92b9-a739cffa7fb1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:17.086363 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-328dddba-9809-4934-9209-3df4f3f8964a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:17.086703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-153c78ca-e578-4826-92b9-a739cffa7fb1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:17.108956 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-328dddba-9809-4934-9209-3df4f3f8964a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.260016 May 28 14:27:17.118725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 345/664] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:16 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:17.170195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:17.170902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:17.188366 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:17.188814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:17.189694 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:17.190209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:17.364755 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-153c78ca-e578-4826-92b9-a739cffa7fb1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:17.374157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-153c78ca-e578-4826-92b9-a739cffa7fb1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.307806 May 28 14:27:17.374742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 320/665] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:17 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:17.451888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:17.461559 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:17.463388 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:17.464941 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.298770 May 28 14:27:17.465902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 346/666] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:17 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:17.778012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a7045b2f-7d62-4fa0-99cc-048d62de32aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:17.779665 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a7045b2f-7d62-4fa0-99cc-048d62de32aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:17.787304 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a7045b2f-7d62-4fa0-99cc-048d62de32aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:17.790222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a7045b2f-7d62-4fa0-99cc-048d62de32aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:17.790222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a7045b2f-7d62-4fa0-99cc-048d62de32aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:17.790222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a7045b2f-7d62-4fa0-99cc-048d62de32aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:18.003763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a7045b2f-7d62-4fa0-99cc-048d62de32aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:18.012882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a7045b2f-7d62-4fa0-99cc-048d62de32aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1317 microversion: 2.1 time: 0.239356 May 28 14:27:18.013795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 321/667] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:17 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:18.126798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a95771dd-f676-48cc-9940-bdb24574ba77 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:18.127422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a95771dd-f676-48cc-9940-bdb24574ba77 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:18.135102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a95771dd-f676-48cc-9940-bdb24574ba77 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:18.136157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a95771dd-f676-48cc-9940-bdb24574ba77 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:18.136966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a95771dd-f676-48cc-9940-bdb24574ba77 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:18.137416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a95771dd-f676-48cc-9940-bdb24574ba77 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:18.404255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a0110eb7-d48f-443e-9564-b437298aad43 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:18.407308 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a0110eb7-d48f-443e-9564-b437298aad43 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:18.433983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0110eb7-d48f-443e-9564-b437298aad43 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:18.444185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0110eb7-d48f-443e-9564-b437298aad43 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:18.445237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0110eb7-d48f-443e-9564-b437298aad43 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:18.445697 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0110eb7-d48f-443e-9564-b437298aad43 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:18.694184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a95771dd-f676-48cc-9940-bdb24574ba77 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:18.700536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a0110eb7-d48f-443e-9564-b437298aad43 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:18.704093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a95771dd-f676-48cc-9940-bdb24574ba77 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.581150 May 28 14:27:18.705232 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 347/668] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:18 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:18.711513 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:18.712516 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:18.722159 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:18.722833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:18.723878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:18.724589 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:18.733098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a0110eb7-d48f-443e-9564-b437298aad43 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.346359 May 28 14:27:18.744678 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 322/669] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:18 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:18.951470 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:18.964660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:18.966334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:18.967644 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d8fa4327-1773-460b-95ff-4b5a58a2c041 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.261221 May 28 14:27:18.968651 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 348/670] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:18 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:19.032522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:19.033160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:19.040627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:19.041093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:19.042418 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:19.042868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:19.276633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:19.286187 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1506 microversion: 2.1 time: 0.259635 May 28 14:27:19.286823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 323/671] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:19 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:19.721350 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:19.721968 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:19.730270 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:19.730441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:19.731207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:19.731692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:19.750623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e2014004-98d9-4aba-90f3-2c04e9e702e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:19.751268 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e2014004-98d9-4aba-90f3-2c04e9e702e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:19.758579 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2014004-98d9-4aba-90f3-2c04e9e702e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:19.759035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2014004-98d9-4aba-90f3-2c04e9e702e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:19.759886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2014004-98d9-4aba-90f3-2c04e9e702e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:19.760817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2014004-98d9-4aba-90f3-2c04e9e702e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:19.939718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:19.949242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.231419 May 28 14:27:19.949831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 349/672] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:19 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:19.972951 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e2014004-98d9-4aba-90f3-2c04e9e702e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:19.985050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e2014004-98d9-4aba-90f3-2c04e9e702e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.235436 May 28 14:27:19.985050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 324/673] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:19 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:19.986415 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:19.987065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:19.994602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:19.995085 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:19.996258 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:19.996784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:20.209344 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:20.223142 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:20.228552 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:20.241103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.247501 May 28 14:27:20.241103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 350/674] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:19 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:20.966657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f196094f-93d8-43c9-abb2-a05e0dce5e3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:20.967279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f196094f-93d8-43c9-abb2-a05e0dce5e3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:20.974530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f196094f-93d8-43c9-abb2-a05e0dce5e3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:20.975114 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f196094f-93d8-43c9-abb2-a05e0dce5e3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:20.976016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f196094f-93d8-43c9-abb2-a05e0dce5e3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:20.976467 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f196094f-93d8-43c9-abb2-a05e0dce5e3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:21.000005 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-385898b6-aa24-4429-b115-227935167434 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:21.000627 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-385898b6-aa24-4429-b115-227935167434 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:21.008279 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-385898b6-aa24-4429-b115-227935167434 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:21.008742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-385898b6-aa24-4429-b115-227935167434 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:21.009535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-385898b6-aa24-4429-b115-227935167434 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:21.010021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-385898b6-aa24-4429-b115-227935167434 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:21.184966 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f196094f-93d8-43c9-abb2-a05e0dce5e3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:21.193383 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f196094f-93d8-43c9-abb2-a05e0dce5e3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.231228 May 28 14:27:21.196312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 325/675] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:20 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:21.209659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-385898b6-aa24-4429-b115-227935167434 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:21.218477 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-385898b6-aa24-4429-b115-227935167434 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.222220 May 28 14:27:21.219378 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 351/676] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:20 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:21.248518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:21.249138 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:21.256557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:21.257015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:21.257798 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:21.258241 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:21.455905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:21.464766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:21.466322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:21.467466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-373f9481-e9ed-4757-9970-63992f880b0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.222755 May 28 14:27:21.468058 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 326/677] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:21 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:22.212260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:22.212894 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:22.221312 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:22.221769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:22.222559 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:22.223050 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:22.235659 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-50eb6cd2-f2d2-4690-b304-92820e850d69 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:22.236309 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-50eb6cd2-f2d2-4690-b304-92820e850d69 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:22.243735 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50eb6cd2-f2d2-4690-b304-92820e850d69 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:22.244447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50eb6cd2-f2d2-4690-b304-92820e850d69 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:22.245220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50eb6cd2-f2d2-4690-b304-92820e850d69 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:22.245678 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50eb6cd2-f2d2-4690-b304-92820e850d69 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:22.449059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:22.449059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.226632 May 28 14:27:22.449059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 352/678] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:22 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:22.454384 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-50eb6cd2-f2d2-4690-b304-92820e850d69 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:22.463007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-50eb6cd2-f2d2-4690-b304-92820e850d69 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.231089 May 28 14:27:22.463535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 327/679] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:22 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:22.485544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:22.486276 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:22.493584 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:22.494383 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:22.495781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:22.496232 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:22.686836 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:22.695313 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:22.696863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:22.698743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-eed918b6-bfef-4db3-88a0-9c321eabe582 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.216304 May 28 14:27:22.699291 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 353/680] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:22 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:23.450224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:23.450841 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:23.458104 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:23.458557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:23.459329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:23.459805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:23.480087 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7427fd74-7199-481c-b155-47969b2efb26 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:23.480713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7427fd74-7199-481c-b155-47969b2efb26 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:23.488037 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7427fd74-7199-481c-b155-47969b2efb26 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:23.488524 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7427fd74-7199-481c-b155-47969b2efb26 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:23.489316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7427fd74-7199-481c-b155-47969b2efb26 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:23.489768 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7427fd74-7199-481c-b155-47969b2efb26 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:23.661694 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:23.670212 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.223674 May 28 14:27:23.670789 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 328/681] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:23 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:23.693065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7427fd74-7199-481c-b155-47969b2efb26 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:23.701959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7427fd74-7199-481c-b155-47969b2efb26 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.226178 May 28 14:27:23.702446 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 354/682] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:23 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:23.717508 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:23.718125 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:23.725263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:23.725719 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:23.726496 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:23.726942 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:23.920621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:23.929431 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:23.931060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:23.932732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.219143 May 28 14:27:23.933323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 329/683] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:23 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:24.685943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7496e4be-5d68-451c-9a10-bad4e177db72 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:24.686596 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7496e4be-5d68-451c-9a10-bad4e177db72 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:24.693751 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7496e4be-5d68-451c-9a10-bad4e177db72 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:24.694212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7496e4be-5d68-451c-9a10-bad4e177db72 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:24.695004 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7496e4be-5d68-451c-9a10-bad4e177db72 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:24.695448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7496e4be-5d68-451c-9a10-bad4e177db72 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:24.718823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a27092b0-351b-4fef-b576-6e943d8c7a97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:24.719541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a27092b0-351b-4fef-b576-6e943d8c7a97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:24.726742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a27092b0-351b-4fef-b576-6e943d8c7a97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:24.727362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a27092b0-351b-4fef-b576-6e943d8c7a97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:24.728148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a27092b0-351b-4fef-b576-6e943d8c7a97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:24.728664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a27092b0-351b-4fef-b576-6e943d8c7a97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:24.899010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7496e4be-5d68-451c-9a10-bad4e177db72 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:24.908226 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7496e4be-5d68-451c-9a10-bad4e177db72 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.225898 May 28 14:27:24.908902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 355/684] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:24 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:24.930715 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a27092b0-351b-4fef-b576-6e943d8c7a97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:24.938876 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a27092b0-351b-4fef-b576-6e943d8c7a97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.223751 May 28 14:27:24.939444 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 330/685] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:24 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:24.950341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:24.950996 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:24.958514 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:24.959003 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:24.959849 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:24.960296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:25.154796 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:25.163669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:25.165537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:25.166259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.219949 May 28 14:27:25.166902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 356/686] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:24 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:25.930313 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:25.930941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:25.938330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:25.938790 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:25.939594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:25.940039 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:25.955303 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:25.955960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:25.963305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:25.964580 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:25.965377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:25.965823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:26.158719 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:26.166814 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.240217 May 28 14:27:26.167736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 331/687] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:25 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:26.170190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:26.178354 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.226719 May 28 14:27:26.178910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 357/688] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:25 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:26.184223 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:26.184889 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:26.191982 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:26.192438 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:26.193212 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:26.193659 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:26.388995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:26.397987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:26.399531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:26.400690 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-65a672da-5364-4d3d-849e-b8add967e5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.220870 May 28 14:27:26.401256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 332/689] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:26 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:27.185527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:27.186195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:27.195009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:27.195009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:27.195009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:27.195321 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:27.200291 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:27.200916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:27.208603 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:27.209064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:27.209841 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:27.210279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:27.394602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:27.403918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.224148 May 28 14:27:27.404698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 358/690] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:27 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:27.415615 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:27.419967 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:27.420723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:27.424686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.227985 May 28 14:27:27.425266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 333/691] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:27 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:27.428320 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:27.428856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:27.429726 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:27.430240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:27.633126 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:27.640119 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:27.641875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:27.643131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.227889 May 28 14:27:27.643805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 359/692] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:27 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:28.420987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:28.421608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:28.429739 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:28.430199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:28.430991 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:28.431461 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:28.441740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:28.442368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:28.450062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:28.450529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:28.451391 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:28.451797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:28.640611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:28.648959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1359 microversion: 2.1 time: 0.232243 May 28 14:27:28.650202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 334/693] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:28 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:28.660667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:28.663256 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:28.684921 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:28.685384 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:28.686190 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:28.686638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:28.719191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:28.728635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.290610 May 28 14:27:28.730204 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 360/694] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:28 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:28.893410 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:28.902742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:28.904396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:28.905539 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.248484 May 28 14:27:28.906103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 335/695] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:28 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:29.106819 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bd206fab-4da1-4e56-8b61-360d66e0a077 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "085f33d8-2f04-4ea3-8aa4-fb5458804707"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:29.107983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bd206fab-4da1-4e56-8b61-360d66e0a077 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:29.115109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bd206fab-4da1-4e56-8b61-360d66e0a077 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:29.115579 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bd206fab-4da1-4e56-8b61-360d66e0a077 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:29.116393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bd206fab-4da1-4e56-8b61-360d66e0a077 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:29.116831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bd206fab-4da1-4e56-8b61-360d66e0a077 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:29.665583 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-78e598b1-4820-4bf9-b7b1-89a95b97f287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:29.666125 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-78e598b1-4820-4bf9-b7b1-89a95b97f287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:29.673891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-78e598b1-4820-4bf9-b7b1-89a95b97f287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:29.674339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-78e598b1-4820-4bf9-b7b1-89a95b97f287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:29.675115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-78e598b1-4820-4bf9-b7b1-89a95b97f287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:29.675569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-78e598b1-4820-4bf9-b7b1-89a95b97f287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:29.871303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-78e598b1-4820-4bf9-b7b1-89a95b97f287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:29.879409 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-78e598b1-4820-4bf9-b7b1-89a95b97f287 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1549 microversion: 2.1 time: 0.217641 May 28 14:27:29.880012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 336/696] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:29 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:29.884234 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e413a341-fae2-42e9-bf21-f842a7a9de12 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:29.884845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e413a341-fae2-42e9-bf21-f842a7a9de12 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:29.892420 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e413a341-fae2-42e9-bf21-f842a7a9de12 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:29.892878 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e413a341-fae2-42e9-bf21-f842a7a9de12 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:29.893655 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e413a341-fae2-42e9-bf21-f842a7a9de12 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:29.894101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e413a341-fae2-42e9-bf21-f842a7a9de12 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:30.156122 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e413a341-fae2-42e9-bf21-f842a7a9de12 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:30.164299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e413a341-fae2-42e9-bf21-f842a7a9de12 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.283329 May 28 14:27:30.164865 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 337/697] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:29 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:30.169842 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f787916d-a47f-47b5-aee8-309b5c4487b3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:30.170453 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f787916d-a47f-47b5-aee8-309b5c4487b3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:30.177293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f787916d-a47f-47b5-aee8-309b5c4487b3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:30.178911 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f787916d-a47f-47b5-aee8-309b5c4487b3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:30.178911 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f787916d-a47f-47b5-aee8-309b5c4487b3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:30.178911 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f787916d-a47f-47b5-aee8-309b5c4487b3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:30.380972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f787916d-a47f-47b5-aee8-309b5c4487b3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:30.389415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f787916d-a47f-47b5-aee8-309b5c4487b3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1549 microversion: 2.1 time: 0.223572 May 28 14:27:30.389993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 338/698] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:30 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1549 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:30.395262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:30.395965 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:30.403240 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:30.403721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:30.404503 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:30.404940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:30.599869 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:30.608681 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:30.610191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:30.611314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-150def93-92cd-48a8-998e-7007845bfbbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.219519 May 28 14:27:30.611900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 339/699] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:30 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:30.616073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:30.620201 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:27:30.620201 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:27:30.621282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:30.622014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Searching by: {'deleted': False, 'project_id': 'cf7193774c754e07a6f683666ab4addf'} {{(pid=106812) get_all /opt/stack/nova/nova/compute/api.py:2832}} May 28 14:27:30.627173 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:30.627650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:30.628452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:30.628886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:30.717782 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.multi_cell_list [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=106812) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 28 14:27:30.807000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-59860adc-d29b-4bd1-b474-a1ac9aa11381 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.194043 May 28 14:27:30.808142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 340/700] 10.222.0.59 () {58 vars in 1125 bytes} [Fri May 28 14:27:30 2021] GET /compute/v2.1/servers => generated 343 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:27:30.818336 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-52207e3c-8aa2-4c0d-a376-714c5386b26e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:30.818590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-52207e3c-8aa2-4c0d-a376-714c5386b26e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:30.826529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-52207e3c-8aa2-4c0d-a376-714c5386b26e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:30.826995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-52207e3c-8aa2-4c0d-a376-714c5386b26e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:30.827800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-52207e3c-8aa2-4c0d-a376-714c5386b26e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:30.828245 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-52207e3c-8aa2-4c0d-a376-714c5386b26e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:31.029601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-52207e3c-8aa2-4c0d-a376-714c5386b26e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:31.037871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-52207e3c-8aa2-4c0d-a376-714c5386b26e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1549 microversion: 2.1 time: 0.223502 May 28 14:27:31.038442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 341/701] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:30 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1549 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:31.181535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:31.182154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:31.190002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:31.190467 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:31.191265 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:31.191744 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:31.385299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:31.393606 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.216022 May 28 14:27:31.394175 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 342/702] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:31 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:31.630106 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:31.630723 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:31.638566 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:31.639022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:31.640811 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:31.640811 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:31.848504 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:31.857816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:31.859350 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:31.860520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7cab14c8-5727-4a41-a75b-ae4094d937f8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1739 microversion: 2.20 time: 0.234272 May 28 14:27:31.861085 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 343/703] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:31 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:32.410234 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-06dd97a7-250b-4031-b18d-89cd975d6389 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:32.410772 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-06dd97a7-250b-4031-b18d-89cd975d6389 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:32.419043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-06dd97a7-250b-4031-b18d-89cd975d6389 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:32.419503 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-06dd97a7-250b-4031-b18d-89cd975d6389 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:32.420330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-06dd97a7-250b-4031-b18d-89cd975d6389 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:32.420792 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-06dd97a7-250b-4031-b18d-89cd975d6389 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:32.638369 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-06dd97a7-250b-4031-b18d-89cd975d6389 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:32.646805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-06dd97a7-250b-4031-b18d-89cd975d6389 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.240427 May 28 14:27:32.647385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 344/704] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:32 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:32.892562 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:32.892562 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:32.892562 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:32.892562 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:32.895183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:32.895183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:33.083547 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:33.092680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:33.094209 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:33.095340 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8378dd7f-b848-4231-9ced-a806164e9031 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1721 microversion: 2.20 time: 0.219666 May 28 14:27:33.095938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 345/705] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:32 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:33.663747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:33.664470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:33.672232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:33.672699 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:33.673548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:33.674000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:33.873383 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:33.881547 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.221576 May 28 14:27:33.882239 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 346/706] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:33 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:34.114113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:34.114762 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:34.123166 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:34.123644 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:34.124429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:34.124871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:34.322294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:34.331708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:34.333229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:34.334417 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-47933de8-287a-47fb-9a7f-1c9c1f01190a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1721 microversion: 2.20 time: 0.224127 May 28 14:27:34.334980 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 347/707] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:34 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:27:34.643868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-12875d4f-a489-4540-8ea9-7b1672705ed1 req-17a7bcfa-7af6-4aa8-a5f6-01dbbb9b7d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c36e73b-e6ab-4203-ada8-e971693460e2", "name": "network-vif-unplugged", "status": "completed", "tag": "c2872b93-4077-4bc0-8619-140f73de2a3a"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:34.643868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:27:34.643868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:27:34.650862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-12875d4f-a489-4540-8ea9-7b1672705ed1 req-17a7bcfa-7af6-4aa8-a5f6-01dbbb9b7d06 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:34.651325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-12875d4f-a489-4540-8ea9-7b1672705ed1 req-17a7bcfa-7af6-4aa8-a5f6-01dbbb9b7d06 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:34.667607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-12875d4f-a489-4540-8ea9-7b1672705ed1 req-17a7bcfa-7af6-4aa8-a5f6-01dbbb9b7d06 service nova] Creating event network-vif-unplugged:c2872b93-4077-4bc0-8619-140f73de2a3a for instance 2c36e73b-e6ab-4203-ada8-e971693460e2 on hv-cinder-79128 May 28 14:27:34.672714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-12875d4f-a489-4540-8ea9-7b1672705ed1 req-17a7bcfa-7af6-4aa8-a5f6-01dbbb9b7d06 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036932 May 28 14:27:34.673326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 348/708] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:27:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:27:34.899129 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c297b6da-4d13-4807-9f1a-201e00cf70d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:34.899849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c297b6da-4d13-4807-9f1a-201e00cf70d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:34.907481 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c297b6da-4d13-4807-9f1a-201e00cf70d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:34.917165 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c297b6da-4d13-4807-9f1a-201e00cf70d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:34.917165 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c297b6da-4d13-4807-9f1a-201e00cf70d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:34.917165 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c297b6da-4d13-4807-9f1a-201e00cf70d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:35.131347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c297b6da-4d13-4807-9f1a-201e00cf70d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:35.140533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c297b6da-4d13-4807-9f1a-201e00cf70d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.245612 May 28 14:27:35.141200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 349/709] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:34 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:35.222484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bd206fab-4da1-4e56-8b61-360d66e0a077 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.119844 May 28 14:27:35.223142 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 361/710] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:27:29 2021] POST /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646/os-volume_attachments => generated 194 bytes in 6121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:27:35.353373 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:35.354682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:35.362274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:35.369585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:35.369585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:35.369585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:35.565012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:35.575172 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:35.576817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:35.578156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1721 microversion: 2.20 time: 0.228505 May 28 14:27:35.578794 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 350/711] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:35 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:36.166216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:36.166216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:36.172802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:36.173275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:36.174066 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:36.174510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:36.381933 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:36.391871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.236792 May 28 14:27:36.392514 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 362/712] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:36 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:36.597620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:36.598262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:36.605551 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:36.607693 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:36.607693 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:36.607693 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:36.814008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:36.823925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:36.825602 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:36.827539 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0c942a9e-0963-47bb-9f9b-a93391141ef4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1721 microversion: 2.20 time: 0.233025 May 28 14:27:36.828137 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 351/713] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:36 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:37.409038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ee49d0a2-b921-4e98-b262-9835c77ba91c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:37.409676 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ee49d0a2-b921-4e98-b262-9835c77ba91c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:37.418129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee49d0a2-b921-4e98-b262-9835c77ba91c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:37.422243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee49d0a2-b921-4e98-b262-9835c77ba91c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:37.422243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee49d0a2-b921-4e98-b262-9835c77ba91c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:37.422243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee49d0a2-b921-4e98-b262-9835c77ba91c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:37.614733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ee49d0a2-b921-4e98-b262-9835c77ba91c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:37.629699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ee49d0a2-b921-4e98-b262-9835c77ba91c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.219936 May 28 14:27:37.629699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 363/714] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:37 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:37.845427 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:37.846050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:37.853259 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:37.853747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:37.855037 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:37.855482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:37.896956 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-65ccf96c-13e6-4b6a-954d-222d4a5c7247 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e44c1036-d0bf-4943-932a-fe3f5b7601a1"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:37.898110 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-65ccf96c-13e6-4b6a-954d-222d4a5c7247 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:37.905755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65ccf96c-13e6-4b6a-954d-222d4a5c7247 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:37.906359 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65ccf96c-13e6-4b6a-954d-222d4a5c7247 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:37.907199 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65ccf96c-13e6-4b6a-954d-222d4a5c7247 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:37.907670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65ccf96c-13e6-4b6a-954d-222d4a5c7247 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:38.067666 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:38.077934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:38.079531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:38.080768 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1724 microversion: 2.20 time: 0.239070 May 28 14:27:38.083582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 352/715] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:37 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:38.101766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7b39108c-9398-4f5e-ab15-a67a222c00c6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34860c84-f53c-4457-941f-96868a5dc84d"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:38.101766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7b39108c-9398-4f5e-ab15-a67a222c00c6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:38.108910 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b39108c-9398-4f5e-ab15-a67a222c00c6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:38.109635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b39108c-9398-4f5e-ab15-a67a222c00c6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:38.110429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b39108c-9398-4f5e-ab15-a67a222c00c6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:38.111050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b39108c-9398-4f5e-ab15-a67a222c00c6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:39.236785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-65ccf96c-13e6-4b6a-954d-222d4a5c7247 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.343356 May 28 14:27:39.237698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 364/716] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:27:37 2021] POST /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments => generated 194 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:27:39.242815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0c47a160-2990-46c3-b57a-cda41e8e4b76 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:39.243518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0c47a160-2990-46c3-b57a-cda41e8e4b76 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:39.252407 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c47a160-2990-46c3-b57a-cda41e8e4b76 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:39.257097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c47a160-2990-46c3-b57a-cda41e8e4b76 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:39.257097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c47a160-2990-46c3-b57a-cda41e8e4b76 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:39.257097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c47a160-2990-46c3-b57a-cda41e8e4b76 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:39.464709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0c47a160-2990-46c3-b57a-cda41e8e4b76 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:39.473366 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0c47a160-2990-46c3-b57a-cda41e8e4b76 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.234460 May 28 14:27:39.473958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 365/717] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:39 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:39.535642 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7b39108c-9398-4f5e-ab15-a67a222c00c6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.439141 May 28 14:27:39.539203 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 353/718] 10.222.0.59 () {62 vars in 1364 bytes} [Fri May 28 14:27:38 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/os-volume_attachments => generated 188 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:27:39.647946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:39.647946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:39.652277 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:39.652746 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:39.653537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:39.654016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:40.038636 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action" status: 202 len: 0 microversion: 2.20 time: 0.397902 May 28 14:27:40.039591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 366/719] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:27:39 2021] POST /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 14:27:40.048102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:40.048994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:40.056482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:40.057007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:40.058307 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:40.058749 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:40.188891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-570b6fe8-4af6-4477-909a-6da1cf031c33 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:40.189396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-570b6fe8-4af6-4477-909a-6da1cf031c33 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:40.197885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-570b6fe8-4af6-4477-909a-6da1cf031c33 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:40.198540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-570b6fe8-4af6-4477-909a-6da1cf031c33 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:40.199222 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-570b6fe8-4af6-4477-909a-6da1cf031c33 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:40.199696 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-570b6fe8-4af6-4477-909a-6da1cf031c33 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:40.264327 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:40.274020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:40.275908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:40.277305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cd32f2f7-f021-466c-98f5-316ebc192aef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1750 microversion: 2.20 time: 0.232921 May 28 14:27:40.278027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 354/720] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:40 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1750 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:40.383830 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-570b6fe8-4af6-4477-909a-6da1cf031c33 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lazy-loading 'services' on Instance uuid 031d9ce3-9559-48b6-b92f-47ac210b74be {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:27:40.496343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-16e135b6-da9e-4026-b4ea-226df299b9a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:40.496343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-16e135b6-da9e-4026-b4ea-226df299b9a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:40.508946 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16e135b6-da9e-4026-b4ea-226df299b9a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:40.509712 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16e135b6-da9e-4026-b4ea-226df299b9a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:40.510796 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16e135b6-da9e-4026-b4ea-226df299b9a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:40.511401 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16e135b6-da9e-4026-b4ea-226df299b9a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:40.724182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-570b6fe8-4af6-4477-909a-6da1cf031c33 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be/os-volume_attachments/d488690a-e115-4729-a105-04815f6001e7" status: 202 len: 0 microversion: 2.1 time: 0.538808 May 28 14:27:40.728072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 367/721] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:27:40 2021] DELETE /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be/os-volume_attachments/d488690a-e115-4729-a105-04815f6001e7 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:27:40.756080 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-16e135b6-da9e-4026-b4ea-226df299b9a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:40.766089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-16e135b6-da9e-4026-b4ea-226df299b9a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.279683 May 28 14:27:40.766977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 355/722] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:40 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:41.297560 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:41.298180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:41.305936 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:41.306425 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:41.308148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:41.308375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:41.511535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:41.521669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:41.523296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:41.524535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-987dec68-b5b2-4cd5-9f29-f6932e463e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1750 microversion: 2.20 time: 0.231369 May 28 14:27:41.525176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 368/723] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:41 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1750 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:41.782421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a41d036e-af51-47d4-b4f6-5424b970c8d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:41.783042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a41d036e-af51-47d4-b4f6-5424b970c8d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:41.791142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a41d036e-af51-47d4-b4f6-5424b970c8d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:41.792105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a41d036e-af51-47d4-b4f6-5424b970c8d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:41.792748 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a41d036e-af51-47d4-b4f6-5424b970c8d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:41.793193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a41d036e-af51-47d4-b4f6-5424b970c8d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:42.004343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a41d036e-af51-47d4-b4f6-5424b970c8d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:42.012806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a41d036e-af51-47d4-b4f6-5424b970c8d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.234144 May 28 14:27:42.013468 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 356/724] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:41 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:42.543614 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:42.544361 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:42.551850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:42.554468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:42.554468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:42.554468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:42.765104 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:42.774423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:42.776575 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:42.777736 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f4141dfe-b50a-4364-a62e-c3739ed905e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.238820 May 28 14:27:42.778335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 369/725] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:42 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:42.803529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-e2b95d40-a63a-4cee-ad62-d7d596f49c95 req-beec0e80-3899-4ddb-ac40-63b4fcfb1dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be0a35c-b0fe-4a26-b785-3e16aa182171", "name": "network-vif-plugged", "status": "completed", "tag": "4b79b510-d52c-4720-bf56-28c541fff0b4"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:42.805270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:27:42.805270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:27:42.813691 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-e2b95d40-a63a-4cee-ad62-d7d596f49c95 req-beec0e80-3899-4ddb-ac40-63b4fcfb1dd2 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:42.814141 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-e2b95d40-a63a-4cee-ad62-d7d596f49c95 req-beec0e80-3899-4ddb-ac40-63b4fcfb1dd2 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:42.829863 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-e2b95d40-a63a-4cee-ad62-d7d596f49c95 req-beec0e80-3899-4ddb-ac40-63b4fcfb1dd2 service nova] Creating event network-vif-plugged:4b79b510-d52c-4720-bf56-28c541fff0b4 for instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 on hv-cinder-79128 May 28 14:27:42.835118 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-e2b95d40-a63a-4cee-ad62-d7d596f49c95 req-beec0e80-3899-4ddb-ac40-63b4fcfb1dd2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035218 May 28 14:27:42.838800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 357/726] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:27:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:27:43.029998 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ea086567-20ff-4df3-b632-0760b929f240 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:43.030544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ea086567-20ff-4df3-b632-0760b929f240 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:43.038036 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea086567-20ff-4df3-b632-0760b929f240 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:43.044107 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea086567-20ff-4df3-b632-0760b929f240 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:43.044107 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea086567-20ff-4df3-b632-0760b929f240 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:43.044107 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea086567-20ff-4df3-b632-0760b929f240 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:43.403940 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ea086567-20ff-4df3-b632-0760b929f240 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:43.412278 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ea086567-20ff-4df3-b632-0760b929f240 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.386668 May 28 14:27:43.412835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 370/727] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:43 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:43.796639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:43.797331 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:43.804721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:43.805312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:43.805931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:43.806370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:44.005334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:44.014594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:44.016171 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:44.017325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.224838 May 28 14:27:44.017897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 358/728] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:43 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:44.427863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-693f4747-5a83-443a-9f8a-75355e201100 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:44.428489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-693f4747-5a83-443a-9f8a-75355e201100 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:44.436346 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-693f4747-5a83-443a-9f8a-75355e201100 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:44.436806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-693f4747-5a83-443a-9f8a-75355e201100 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:44.437589 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-693f4747-5a83-443a-9f8a-75355e201100 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:44.438033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-693f4747-5a83-443a-9f8a-75355e201100 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:44.632930 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-693f4747-5a83-443a-9f8a-75355e201100 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:44.641071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-693f4747-5a83-443a-9f8a-75355e201100 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1266 microversion: 2.1 time: 0.216887 May 28 14:27:44.641632 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 371/729] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:44 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:45.036992 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:45.037630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:45.046314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.046778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.047624 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.048075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.257660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:45.267800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:45.269320 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:45.270454 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.237461 May 28 14:27:45.271010 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 359/730] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:45 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:45.657586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:45.658304 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:45.666080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.667090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.667924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.668361 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.861120 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:45.870084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1453 microversion: 2.1 time: 0.215981 May 28 14:27:45.870702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 372/731] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:45 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1453 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:45.886215 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:45.886838 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:45.894159 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.894615 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.895387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.895845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:46.153015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:46.161324 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1453 microversion: 2.1 time: 0.278846 May 28 14:27:46.161892 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 360/732] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:45 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1453 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:46.290259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:46.291374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:46.300467 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:46.301672 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:46.302841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:46.303685 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:46.539084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:46.548668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:46.550275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:46.551469 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a9996133-ec4a-4c94-bf52-84c711ec626a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.265700 May 28 14:27:46.555609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 373/733] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:46 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:47.582827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:47.582827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:47.582827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:47.582827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:47.583978 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:47.583978 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:47.821175 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:47.831126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:47.832686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:47.833835 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-af7c9f69-e12d-4078-bd3a-e424971e86e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.267513 May 28 14:27:47.834483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 361/734] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:47 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:48.852495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:48.853116 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:48.860598 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:48.861058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:48.861850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:48.862295 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:49.066791 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:49.071247 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:49.072871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:49.074004 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f78efc19-d2a6-414e-a32b-55b1408b06af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.225280 May 28 14:27:49.074561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 374/735] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:48 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:49.267255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-bf9af210-4f57-492a-ab16-b7c1df5cde7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be0a35c-b0fe-4a26-b785-3e16aa182171", "tag": "4b79b510-d52c-4720-bf56-28c541fff0b4"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:49.267255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:27:49.267255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:27:49.274598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-bf9af210-4f57-492a-ab16-b7c1df5cde7a service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:49.275061 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-bf9af210-4f57-492a-ab16-b7c1df5cde7a service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:49.292338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-bf9af210-4f57-492a-ab16-b7c1df5cde7a service nova] Creating event network-changed:4b79b510-d52c-4720-bf56-28c541fff0b4 for instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 on hv-cinder-79128 May 28 14:27:49.297492 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-bf9af210-4f57-492a-ab16-b7c1df5cde7a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093339 May 28 14:27:49.298102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 362/736] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:27:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:27:50.092978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:50.093657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:50.101116 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:50.101595 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:50.102371 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:50.102813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:50.303883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:50.314505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:50.316106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:50.317486 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4f78a928-9117-4ca9-b7e4-9d0606652f5a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.228827 May 28 14:27:50.321967 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 375/737] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:50 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:51.337102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:51.337811 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:51.345272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:51.345732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:51.346512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:51.346954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:51.540829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:51.550467 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:51.552022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:51.553155 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bd6880c9-8122-4140-bf85-58e549753a02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.220249 May 28 14:27:51.553716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 363/738] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:51 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:52.571744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:52.572368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:52.580226 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:52.580687 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:52.581465 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:52.581907 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:52.773137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:52.782340 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:52.783902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:52.785045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7c56b553-7f7b-4707-880a-5674a4babf0e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.217098 May 28 14:27:52.785637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 376/739] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:52 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:52.893287 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:27:52.893812 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:27:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:27:53.803506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:53.804146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:53.811636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:53.812089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:53.812868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:53.813305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:54.020558 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:54.032410 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:54.033937 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:54.035466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.235850 May 28 14:27:54.036216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 364/740] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:53 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:55.053975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:55.056060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:55.063831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:55.064314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:55.065068 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:55.065506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:55.344929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:55.354219 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:55.355789 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:55.356936 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.306835 May 28 14:27:55.357493 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 377/741] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:55 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:55.461790 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2034394422", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "37e18bf5-545d-49a2-afdf-585587a7907f"}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:27:55.530713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] validate_networks() for [('37e18bf5-545d-49a2-afdf-585587a7907f', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:27:56.375795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:56.376420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:56.383876 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:56.384333 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:56.385173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:56.385792 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:56.395522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:27:56.395522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:27:56.395522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:27:56.395522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:27:56.395522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:27:56.403299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:56.403809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:56.404599 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:56.405037 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:56.426552 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Getting quotas for project 94dc9f7ad5dd40429991c68c00e7ec6d. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:27:56.432629 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Getting quotas for user d9be4db3bc1f4c2386bacaee2c9232ea and project 94dc9f7ad5dd40429991c68c00e7ec6d. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:27:56.444005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:27:56.446321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:27:56.586545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:56.598438 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:56.601164 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:56.602963 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f8223923-ee3d-4f57-a749-9934ebbf85c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.231835 May 28 14:27:56.604738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 378/742] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:56 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:56.626205 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c831fe84-88b8-4d7f-8d7c-12553538e900 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167986 May 28 14:27:56.627104 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 365/743] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:27:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:27:56.636820 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5c215399-759e-41f5-b757-6f6a24f2505a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:56.637441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5c215399-759e-41f5-b757-6f6a24f2505a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:56.712179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5c215399-759e-41f5-b757-6f6a24f2505a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:56.720528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5c215399-759e-41f5-b757-6f6a24f2505a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1218 microversion: 2.1 time: 0.087516 May 28 14:27:56.721100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 379/744] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:56 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:27:57.623958 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:57.624578 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:57.631975 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:57.632553 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:57.633202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:57.633645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:57.738024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9413808d-8c29-41f6-b0ab-3a202429cf23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:57.738667 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9413808d-8c29-41f6-b0ab-3a202429cf23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:57.750425 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9413808d-8c29-41f6-b0ab-3a202429cf23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:57.750888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9413808d-8c29-41f6-b0ab-3a202429cf23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:57.751711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9413808d-8c29-41f6-b0ab-3a202429cf23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:57.752149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9413808d-8c29-41f6-b0ab-3a202429cf23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:57.837533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:57.847392 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:57.848968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:57.850117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-27f50468-9166-4187-a5d6-df6728b3cf2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.230759 May 28 14:27:57.850682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 366/745] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:57 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:27:57.867902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9413808d-8c29-41f6-b0ab-3a202429cf23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:57.876871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9413808d-8c29-41f6-b0ab-3a202429cf23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1222 microversion: 2.1 time: 0.142684 May 28 14:27:57.877440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 380/746] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:57 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:58.869102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:58.870270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:58.877861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:58.878179 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:58.878870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:58.879314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:58.893668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fcf8b641-e901-42d0-998d-72b45e40e143 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:27:58.894440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fcf8b641-e901-42d0-998d-72b45e40e143 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:27:58.902631 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fcf8b641-e901-42d0-998d-72b45e40e143 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:58.903131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fcf8b641-e901-42d0-998d-72b45e40e143 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:58.904012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fcf8b641-e901-42d0-998d-72b45e40e143 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:58.904518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fcf8b641-e901-42d0-998d-72b45e40e143 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:59.055681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fcf8b641-e901-42d0-998d-72b45e40e143 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:59.064408 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fcf8b641-e901-42d0-998d-72b45e40e143 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1270 microversion: 2.1 time: 0.174561 May 28 14:27:59.065337 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 381/747] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:27:58 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:27:59.080943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:59.090845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:59.092407 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:27:59.093551 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1e0abc66-6c7b-4605-9a17-12d2035389f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.228403 May 28 14:27:59.094509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 367/748] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:27:58 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:00.083884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-75f95863-c39f-406a-aaeb-a83b948ac0fd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:00.085082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-75f95863-c39f-406a-aaeb-a83b948ac0fd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:00.095304 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-75f95863-c39f-406a-aaeb-a83b948ac0fd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:00.095999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-75f95863-c39f-406a-aaeb-a83b948ac0fd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:00.097147 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-75f95863-c39f-406a-aaeb-a83b948ac0fd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:00.097893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-75f95863-c39f-406a-aaeb-a83b948ac0fd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:00.113809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:00.115233 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:00.127840 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:00.129881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:00.130725 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:00.131178 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:00.367268 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:00.377456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:00.378993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:00.380198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.271507 May 28 14:28:00.380198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 368/749] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:00 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:00.661259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-75f95863-c39f-406a-aaeb-a83b948ac0fd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:00.671020 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-75f95863-c39f-406a-aaeb-a83b948ac0fd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.591019 May 28 14:28:00.683695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 382/750] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:00 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:01.399088 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:01.399819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:01.408569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:01.409029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:01.409826 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:01.410272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:01.620650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:01.631778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:01.633752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:01.635130 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c0450d46-3582-47be-8513-01c8cce3e1db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.240031 May 28 14:28:01.635902 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 369/751] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:01 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:01.653454 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-8b7ddf20-965e-4f0f-ab50-bfb315bffd9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fecfff25-834b-4f86-b9dc-0e95c9fba46d", "tag": "c5a95e0a-897e-42cc-bae7-653a3a321292"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:01.655054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:01.655054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:28:01.663263 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-8b7ddf20-965e-4f0f-ab50-bfb315bffd9b service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:01.663740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-8b7ddf20-965e-4f0f-ab50-bfb315bffd9b service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:01.683494 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-8b7ddf20-965e-4f0f-ab50-bfb315bffd9b service nova] Creating event network-changed:c5a95e0a-897e-42cc-bae7-653a3a321292 for instance fecfff25-834b-4f86-b9dc-0e95c9fba46d on hv-cinder-79128 May 28 14:28:01.688299 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-8b7ddf20-965e-4f0f-ab50-bfb315bffd9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039578 May 28 14:28:01.689640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 383/752] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:28:01.696855 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:01.697509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:01.705007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:01.705465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:01.706260 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:01.706700 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:01.929677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:01.939568 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.246499 May 28 14:28:01.940470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 370/753] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:01 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:02.654623 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:02.655443 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:02.663158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:02.663801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:02.664788 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:02.665330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:02.912295 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:02.925982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:02.928109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:02.929704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.279718 May 28 14:28:02.930475 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 384/754] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:02 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:02.957402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:02.958079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:02.966140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:02.966591 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:02.967402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:02.967885 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:03.194461 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:03.204411 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.250907 May 28 14:28:03.204994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 371/755] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:02 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:03.951707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:03.952330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:03.959718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:03.960466 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:03.961265 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:03.961745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:04.155220 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:04.164543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:04.166064 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:04.167999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.220522 May 28 14:28:04.168562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 385/756] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:03 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:04.221665 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f7684504-4193-452d-8722-422e29ade708 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:04.223134 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f7684504-4193-452d-8722-422e29ade708 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:04.230019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7684504-4193-452d-8722-422e29ade708 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:04.230511 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7684504-4193-452d-8722-422e29ade708 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:04.231279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7684504-4193-452d-8722-422e29ade708 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:04.231755 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7684504-4193-452d-8722-422e29ade708 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:04.426334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f7684504-4193-452d-8722-422e29ade708 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:04.434533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f7684504-4193-452d-8722-422e29ade708 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.216627 May 28 14:28:04.435096 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 372/757] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:04 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:05.185997 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:05.186544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:05.194003 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:05.194467 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:05.195316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:05.195797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:05.450498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7de1019a-cc24-494f-bcf4-f7a4592fde10 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:05.451125 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7de1019a-cc24-494f-bcf4-f7a4592fde10 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:05.459339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7de1019a-cc24-494f-bcf4-f7a4592fde10 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:05.459904 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7de1019a-cc24-494f-bcf4-f7a4592fde10 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:05.460721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7de1019a-cc24-494f-bcf4-f7a4592fde10 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:05.461160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7de1019a-cc24-494f-bcf4-f7a4592fde10 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:05.473142 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:05.483188 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:05.486037 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:05.487277 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a648163b-6b01-4193-9f4a-025aeff29765 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.305173 May 28 14:28:05.487990 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 386/758] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:05 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:05.661092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7de1019a-cc24-494f-bcf4-f7a4592fde10 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:05.669199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7de1019a-cc24-494f-bcf4-f7a4592fde10 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.222561 May 28 14:28:05.669777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 373/759] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:05 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:05.790310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-419808017", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:05.855436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] validate_networks() for None {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:28:06.106302 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:28:06.106740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:28:06.107223 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:28:06.107668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:28:06.108092 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:28:06.116582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:06.117039 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:06.117860 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:06.118305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:06.136440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Getting quotas for project a3794d25c6c34e459ce43288d19e5cbf. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:28:06.140456 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Getting quotas for user c16053fd78754225a5aa271b5ee84295 and project a3794d25c6c34e459ce43288d19e5cbf. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:28:06.152184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:28:06.155866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:28:06.279508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cbcd9882-fac4-424e-9eca-89dc5b631458 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492769 May 28 14:28:06.280238 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 387/760] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:28:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:28:06.290101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c9997479-a1e7-4604-b83e-cf0c3c5ee70e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:06.290735 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c9997479-a1e7-4604-b83e-cf0c3c5ee70e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:06.360238 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c9997479-a1e7-4604-b83e-cf0c3c5ee70e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:06.368007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c9997479-a1e7-4604-b83e-cf0c3c5ee70e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1214 microversion: 2.1 time: 0.081706 May 28 14:28:06.368591 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 374/761] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:06 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:06.505787 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:06.506407 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:06.514716 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:06.515492 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:06.516072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:06.516548 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:06.686458 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-79815bf6-943f-46bc-88df-8796e7518b3e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:06.687785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-79815bf6-943f-46bc-88df-8796e7518b3e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:06.696194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79815bf6-943f-46bc-88df-8796e7518b3e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:06.696890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79815bf6-943f-46bc-88df-8796e7518b3e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:06.698417 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79815bf6-943f-46bc-88df-8796e7518b3e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:06.699029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-79815bf6-943f-46bc-88df-8796e7518b3e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:06.714781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:06.724718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:06.726718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:06.728577 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-20423a12-7250-40b9-a455-afc2982f9a2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.226085 May 28 14:28:06.729135 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 388/762] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:06 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:06.929677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-79815bf6-943f-46bc-88df-8796e7518b3e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:06.937838 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-79815bf6-943f-46bc-88df-8796e7518b3e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.255104 May 28 14:28:06.938414 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 375/763] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:06 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:07.385062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3296e20e-7f55-4d8d-b42c-f616fee94e66 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:07.385720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3296e20e-7f55-4d8d-b42c-f616fee94e66 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:07.393137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3296e20e-7f55-4d8d-b42c-f616fee94e66 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:07.393589 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3296e20e-7f55-4d8d-b42c-f616fee94e66 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:07.394632 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3296e20e-7f55-4d8d-b42c-f616fee94e66 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:07.395075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3296e20e-7f55-4d8d-b42c-f616fee94e66 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:07.507765 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3296e20e-7f55-4d8d-b42c-f616fee94e66 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:07.516024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3296e20e-7f55-4d8d-b42c-f616fee94e66 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1218 microversion: 2.1 time: 0.134666 May 28 14:28:07.516586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 389/764] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:07 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:07.747052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:07.748319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:07.756058 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:07.756575 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:07.757433 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:07.757873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:07.954407 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d9ca0f4f-5e27-4d87-998e-1256c5428abc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:07.955094 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d9ca0f4f-5e27-4d87-998e-1256c5428abc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:07.962565 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9ca0f4f-5e27-4d87-998e-1256c5428abc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:07.963112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9ca0f4f-5e27-4d87-998e-1256c5428abc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:07.963938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9ca0f4f-5e27-4d87-998e-1256c5428abc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:07.964385 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9ca0f4f-5e27-4d87-998e-1256c5428abc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:07.972598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:07.983261 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:07.984982 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:07.986226 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c7993876-1f95-4644-9dcb-741b672f1dea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.244372 May 28 14:28:08.001914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 376/765] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:07 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:08.184912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d9ca0f4f-5e27-4d87-998e-1256c5428abc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:08.193321 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d9ca0f4f-5e27-4d87-998e-1256c5428abc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.242844 May 28 14:28:08.193890 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 390/766] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:07 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:08.532799 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-19f468bf-69dd-461e-97c8-a64d3302559c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:08.533413 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-19f468bf-69dd-461e-97c8-a64d3302559c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:08.540660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-19f468bf-69dd-461e-97c8-a64d3302559c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:08.541123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-19f468bf-69dd-461e-97c8-a64d3302559c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:08.541888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-19f468bf-69dd-461e-97c8-a64d3302559c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:08.542318 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-19f468bf-69dd-461e-97c8-a64d3302559c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:08.655005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-19f468bf-69dd-461e-97c8-a64d3302559c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:08.663043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-19f468bf-69dd-461e-97c8-a64d3302559c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1266 microversion: 2.1 time: 0.133997 May 28 14:28:08.663620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 377/767] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:08 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:09.005869 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:09.006571 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:09.014210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.014670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.015593 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.016058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.210779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-430b06b9-d71f-4578-9855-22c7fb6c1193 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:09.212048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-430b06b9-d71f-4578-9855-22c7fb6c1193 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:09.220246 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-430b06b9-d71f-4578-9855-22c7fb6c1193 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.220909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-430b06b9-d71f-4578-9855-22c7fb6c1193 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.221849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-430b06b9-d71f-4578-9855-22c7fb6c1193 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.222448 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-430b06b9-d71f-4578-9855-22c7fb6c1193 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.426197 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:09.440368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:09.443322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:09.448022 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.445946 May 28 14:28:09.451013 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 391/768] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:09 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:09.463272 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e758e2ee-6322-44c1-8662-7547ef02600b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:09.464026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e758e2ee-6322-44c1-8662-7547ef02600b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:09.488218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-430b06b9-d71f-4578-9855-22c7fb6c1193 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:09.496717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e758e2ee-6322-44c1-8662-7547ef02600b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.497175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e758e2ee-6322-44c1-8662-7547ef02600b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.497987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e758e2ee-6322-44c1-8662-7547ef02600b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.498445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e758e2ee-6322-44c1-8662-7547ef02600b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.507330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-430b06b9-d71f-4578-9855-22c7fb6c1193 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.300349 May 28 14:28:09.527370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 378/769] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:09 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:09.580973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:09.581873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:09.590753 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.591620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.593602 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.594249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.662723 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:28:09.799289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e758e2ee-6322-44c1-8662-7547ef02600b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:09.809106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e758e2ee-6322-44c1-8662-7547ef02600b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1595 microversion: 2.1 time: 0.356806 May 28 14:28:09.815089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 392/770] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:09 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1595 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:09.815089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-32c9534f-5407-4705-9b23-cf2df9f92cfa tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:09.815089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-32c9534f-5407-4705-9b23-cf2df9f92cfa tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:09.823368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-32c9534f-5407-4705-9b23-cf2df9f92cfa tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.823864 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-32c9534f-5407-4705-9b23-cf2df9f92cfa tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.824659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-32c9534f-5407-4705-9b23-cf2df9f92cfa tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:09.825092 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-32c9534f-5407-4705-9b23-cf2df9f92cfa tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:09.946530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-32c9534f-5407-4705-9b23-cf2df9f92cfa tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:09.954860 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-32c9534f-5407-4705-9b23-cf2df9f92cfa tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1272 microversion: 2.1 time: 0.144179 May 28 14:28:09.955428 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 393/771] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:09 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:10.029212 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 204 len: 0 microversion: 2.1 time: 0.451811 May 28 14:28:10.033267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 379/772] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:28:09 2021] DELETE /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:28:10.038301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:10.038998 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:10.046945 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:10.047217 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:10.048229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:10.048738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:10.407301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:10.417045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1513 microversion: 2.1 time: 0.381848 May 28 14:28:10.426805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 394/773] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:10 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:10.473933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:10.474605 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:10.491632 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:10.492099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:10.492901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:10.493346 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:10.527518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-921b4996-b7af-435e-9036-bd8fc75d6c76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:10.528719 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-921b4996-b7af-435e-9036-bd8fc75d6c76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:10.536554 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-921b4996-b7af-435e-9036-bd8fc75d6c76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:10.537304 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-921b4996-b7af-435e-9036-bd8fc75d6c76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:10.538439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-921b4996-b7af-435e-9036-bd8fc75d6c76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:10.539101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-921b4996-b7af-435e-9036-bd8fc75d6c76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:10.920514 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:10.932003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:10.933846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:10.941064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a671216d-9290-4c79-a1a3-dddfc52e5f46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1752 microversion: 2.20 time: 0.469429 May 28 14:28:10.941064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 380/774] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:10 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1752 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:10.974512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:10.975740 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:10.976839 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-921b4996-b7af-435e-9036-bd8fc75d6c76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:10.987282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:10.988209 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:10.989253 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:10.989949 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:10.994750 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-921b4996-b7af-435e-9036-bd8fc75d6c76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.471587 May 28 14:28:11.004621 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 395/775] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:10 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:11.086062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-d06413bd-09b6-4f26-b83c-43b3e3828cd2 req-dba03690-5c35-49ea-8ba5-fd081a5fb5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecfff25-834b-4f86-b9dc-0e95c9fba46d", "name": "network-vif-plugged", "status": "completed", "tag": "c5a95e0a-897e-42cc-bae7-653a3a321292"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:11.090740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:11.090740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:28:11.100771 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-d06413bd-09b6-4f26-b83c-43b3e3828cd2 req-dba03690-5c35-49ea-8ba5-fd081a5fb5c6 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:11.101491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-d06413bd-09b6-4f26-b83c-43b3e3828cd2 req-dba03690-5c35-49ea-8ba5-fd081a5fb5c6 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:11.120662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-d06413bd-09b6-4f26-b83c-43b3e3828cd2 req-dba03690-5c35-49ea-8ba5-fd081a5fb5c6 service nova] Creating event network-vif-plugged:c5a95e0a-897e-42cc-bae7-653a3a321292 for instance fecfff25-834b-4f86-b9dc-0e95c9fba46d on hv-cinder-79128 May 28 14:28:11.125787 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-d06413bd-09b6-4f26-b83c-43b3e3828cd2 req-dba03690-5c35-49ea-8ba5-fd081a5fb5c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049196 May 28 14:28:11.126393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 396/776] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:28:11.437341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4cf04598-2beb-48cb-9a28-b0b883130a2c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:11.438718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4cf04598-2beb-48cb-9a28-b0b883130a2c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:11.440345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:11.448800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4cf04598-2beb-48cb-9a28-b0b883130a2c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:11.449717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4cf04598-2beb-48cb-9a28-b0b883130a2c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:11.450782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4cf04598-2beb-48cb-9a28-b0b883130a2c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:11.451448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4cf04598-2beb-48cb-9a28-b0b883130a2c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:11.455033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.484528 May 28 14:28:11.459987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 381/777] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:10 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:11.863472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4cf04598-2beb-48cb-9a28-b0b883130a2c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:11.872905 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4cf04598-2beb-48cb-9a28-b0b883130a2c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1513 microversion: 2.1 time: 0.442386 May 28 14:28:11.873836 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 397/778] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:11 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1513 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:11.956020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:11.956786 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:11.965025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:11.965545 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:11.966486 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:11.966934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:12.012343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-79c20873-337d-4b30-ba31-387f65f9fb19 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:12.012982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-79c20873-337d-4b30-ba31-387f65f9fb19 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:12.027069 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-79c20873-337d-4b30-ba31-387f65f9fb19 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:12.027537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-79c20873-337d-4b30-ba31-387f65f9fb19 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:12.028406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-79c20873-337d-4b30-ba31-387f65f9fb19 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:12.028847 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-79c20873-337d-4b30-ba31-387f65f9fb19 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:12.493032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-79c20873-337d-4b30-ba31-387f65f9fb19 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:12.497794 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:12.506691 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-79c20873-337d-4b30-ba31-387f65f9fb19 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.498755 May 28 14:28:12.516516 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:12.516516 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:12.516516 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.563422 May 28 14:28:12.516850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 382/779] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:11 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:12.518029 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 398/780] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:12 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:12.519831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:12.520801 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:12.528585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:12.529164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:12.530047 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:12.530716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:12.870822 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-42181018-6ba1-4047-ad1b-834110c441f9 req-8f311252-6cb9-4a11-b671-5cccc273c49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770", "tag": "2ed41bb3-bd69-4be3-a916-04232779f1d0"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:12.872461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:12.872461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:28:12.888286 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-42181018-6ba1-4047-ad1b-834110c441f9 req-8f311252-6cb9-4a11-b671-5cccc273c49b service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:12.888731 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-42181018-6ba1-4047-ad1b-834110c441f9 req-8f311252-6cb9-4a11-b671-5cccc273c49b service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:12.910687 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-42181018-6ba1-4047-ad1b-834110c441f9 req-8f311252-6cb9-4a11-b671-5cccc273c49b service nova] Creating event network-changed:2ed41bb3-bd69-4be3-a916-04232779f1d0 for instance 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 on hv-cinder-79128 May 28 14:28:12.923923 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-42181018-6ba1-4047-ad1b-834110c441f9 req-8f311252-6cb9-4a11-b671-5cccc273c49b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057716 May 28 14:28:12.925115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 399/781] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:28:12.931543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fa0b9ce0-b361-47e0-a305-a38488597fc9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:12.932471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fa0b9ce0-b361-47e0-a305-a38488597fc9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:12.949827 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa0b9ce0-b361-47e0-a305-a38488597fc9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:12.950592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa0b9ce0-b361-47e0-a305-a38488597fc9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:12.952016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa0b9ce0-b361-47e0-a305-a38488597fc9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:12.952623 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa0b9ce0-b361-47e0-a305-a38488597fc9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:13.050689 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:13.064449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.548635 May 28 14:28:13.075410 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 383/782] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:12 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:13.437858 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-0611f763-60d1-4c8f-97f7-2555d23f0750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4", "tag": "164fd7c8-7a57-4285-93ef-c3fdabceb8be"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:13.440198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:13.440198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:28:13.450891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-0611f763-60d1-4c8f-97f7-2555d23f0750 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:13.454853 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fa0b9ce0-b361-47e0-a305-a38488597fc9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:13.460855 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-0611f763-60d1-4c8f-97f7-2555d23f0750 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:13.468445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fa0b9ce0-b361-47e0-a305-a38488597fc9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1513 microversion: 2.1 time: 0.541923 May 28 14:28:13.482696 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 400/783] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:12 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1513 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:13.492802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-0611f763-60d1-4c8f-97f7-2555d23f0750 service nova] Creating event network-changed:164fd7c8-7a57-4285-93ef-c3fdabceb8be for instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 on hv-cinder-79128 May 28 14:28:13.498571 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-0611f763-60d1-4c8f-97f7-2555d23f0750 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064934 May 28 14:28:13.499668 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 384/784] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:28:13.524078 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6dfd7426-bf34-4543-b696-d10dde30085e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:13.524922 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6dfd7426-bf34-4543-b696-d10dde30085e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:13.533681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6dfd7426-bf34-4543-b696-d10dde30085e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:13.534266 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6dfd7426-bf34-4543-b696-d10dde30085e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:13.535150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6dfd7426-bf34-4543-b696-d10dde30085e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:13.535620 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6dfd7426-bf34-4543-b696-d10dde30085e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:13.543337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:13.544110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:13.553603 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:13.554063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:13.554864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:13.555487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:14.253993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:14.272000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:14.277253 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:14.277741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-588db33d-3621-4ca7-86a7-2b29295b7265 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.738503 May 28 14:28:14.289747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 385/785] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:13 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:14.296510 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:14.297791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:14.311050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:14.312328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:14.317293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:14.317293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:14.453495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6dfd7426-bf34-4543-b696-d10dde30085e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:14.473980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6dfd7426-bf34-4543-b696-d10dde30085e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1318 microversion: 2.1 time: 0.953663 May 28 14:28:14.486638 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 401/786] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:13 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:14.492254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-453e4e3a-c79f-4b3b-9541-f0bebd80605b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:14.492874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-453e4e3a-c79f-4b3b-9541-f0bebd80605b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:14.501171 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-453e4e3a-c79f-4b3b-9541-f0bebd80605b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:14.501622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-453e4e3a-c79f-4b3b-9541-f0bebd80605b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:14.502766 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-453e4e3a-c79f-4b3b-9541-f0bebd80605b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:14.503357 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-453e4e3a-c79f-4b3b-9541-f0bebd80605b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:14.630495 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:14.640534 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.347105 May 28 14:28:14.641249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 386/787] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:14 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:14.792015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-453e4e3a-c79f-4b3b-9541-f0bebd80605b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:14.802628 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-453e4e3a-c79f-4b3b-9541-f0bebd80605b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1471 microversion: 2.1 time: 0.314818 May 28 14:28:14.813674 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 402/788] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:14 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:15.296087 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:15.296739 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:15.309579 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.309579 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:15.309853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.310422 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:15.496366 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:15.497008 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:15.509491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.512657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:15.513514 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.513962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:15.679759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:15.701014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:15.704386 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:15.706729 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4d8c3d4e-1e82-472d-9dd6-47687d30168b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.414751 May 28 14:28:15.708614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 387/789] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:15 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:15.717136 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-b1c5bc4c-9b74-42ea-b97d-7d898db6949c req-33b33f1f-1ecf-4ffc-bc8f-f06984cea7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031d9ce3-9559-48b6-b92f-47ac210b74be", "name": "network-vif-deleted", "tag": "15e73ba1-bc57-49ac-bae9-9906c3fe9522"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:15.721021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:15.721021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:28:15.737278 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-b1c5bc4c-9b74-42ea-b97d-7d898db6949c req-33b33f1f-1ecf-4ffc-bc8f-f06984cea7f8 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.738395 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-b1c5bc4c-9b74-42ea-b97d-7d898db6949c req-33b33f1f-1ecf-4ffc-bc8f-f06984cea7f8 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:15.772370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-b1c5bc4c-9b74-42ea-b97d-7d898db6949c req-33b33f1f-1ecf-4ffc-bc8f-f06984cea7f8 service nova] Creating event network-vif-deleted:15e73ba1-bc57-49ac-bae9-9906c3fe9522 for instance 031d9ce3-9559-48b6-b92f-47ac210b74be on hv-cinder-79128 May 28 14:28:15.781743 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-b1c5bc4c-9b74-42ea-b97d-7d898db6949c req-33b33f1f-1ecf-4ffc-bc8f-f06984cea7f8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070841 May 28 14:28:15.787293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 388/790] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:28:15.794418 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-77bb964a-139f-47eb-b449-1953d5c828fc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:15.795132 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-77bb964a-139f-47eb-b449-1953d5c828fc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:15.803148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-77bb964a-139f-47eb-b449-1953d5c828fc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.803635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-77bb964a-139f-47eb-b449-1953d5c828fc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:15.804777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-77bb964a-139f-47eb-b449-1953d5c828fc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.804961 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-77bb964a-139f-47eb-b449-1953d5c828fc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:15.928112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:15.943977 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1507 microversion: 2.1 time: 0.453624 May 28 14:28:15.945654 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 403/791] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:15 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:15.954731 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-17de9032-b315-45ea-97c3-442c4f4ea030 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:15.956201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-17de9032-b315-45ea-97c3-442c4f4ea030 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:15.971127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-17de9032-b315-45ea-97c3-442c4f4ea030 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.971622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-17de9032-b315-45ea-97c3-442c4f4ea030 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:15.972516 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-17de9032-b315-45ea-97c3-442c4f4ea030 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:15.972960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-17de9032-b315-45ea-97c3-442c4f4ea030 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:16.071402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-77bb964a-139f-47eb-b449-1953d5c828fc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:16.081083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-77bb964a-139f-47eb-b449-1953d5c828fc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.292288 May 28 14:28:16.082100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 389/792] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:15 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:16.087189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "085f33d8-2f04-4ea3-8aa4-fb5458804707"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:16.088321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:16.096436 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:16.098912 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:16.098912 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:16.098912 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:16.119740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-17de9032-b315-45ea-97c3-442c4f4ea030 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:16.128376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-17de9032-b315-45ea-97c3-442c4f4ea030 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.181325 May 28 14:28:16.129063 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 404/793] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:15 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:16.269951 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] HTTP exception thrown: Invalid volume: volume 085f33d8-2f04-4ea3-8aa4-fb5458804707 is already attached to instances: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 May 28 14:28:16.270943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Returning 400 to user: Invalid volume: volume 085f33d8-2f04-4ea3-8aa4-fb5458804707 is already attached to instances: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:28:16.271816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6374d8db-a95b-4dc5-a5e8-290f63780385 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.188651 May 28 14:28:16.276237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 390/794] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:28:16 2021] POST /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d/os-volume_attachments => generated 174 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 14:28:16.394127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8de31911-da9c-4091-bf94-c587e68fbf4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:16.394662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8de31911-da9c-4091-bf94-c587e68fbf4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:16.402825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8de31911-da9c-4091-bf94-c587e68fbf4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:16.403802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8de31911-da9c-4091-bf94-c587e68fbf4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:16.404112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8de31911-da9c-4091-bf94-c587e68fbf4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:16.404705 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8de31911-da9c-4091-bf94-c587e68fbf4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:16.585150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-8de31911-da9c-4091-bf94-c587e68fbf4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lazy-loading 'services' on Instance uuid 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:28:16.726325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:16.727121 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:16.736098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:16.736564 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:16.737521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:16.737973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:16.894699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8de31911-da9c-4091-bf94-c587e68fbf4e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646/os-volume_attachments/085f33d8-2f04-4ea3-8aa4-fb5458804707" status: 202 len: 0 microversion: 2.1 time: 0.500424 May 28 14:28:16.894699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 405/795] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:28:16 2021] DELETE /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646/os-volume_attachments/085f33d8-2f04-4ea3-8aa4-fb5458804707 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:28:17.013068 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:17.022809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:17.024414 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:17.025683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-63d74ea9-a223-4912-a6e3-d3ab6690e736 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.303504 May 28 14:28:17.029862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 391/796] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:16 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:17.098687 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:17.100328 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:17.109454 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:17.109908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:17.110732 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:17.111169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:17.145591 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:17.146107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:17.154307 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:17.154760 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:17.155537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:17.155994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:17.547837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:17.557647 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.415510 May 28 14:28:17.567329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 392/797] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:17 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:17.674913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:17.684432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.590231 May 28 14:28:17.685475 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 406/798] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:17 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:18.045960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:18.046617 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:18.054485 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:18.055191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:18.056202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:18.057034 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:18.278985 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:18.289551 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:18.293232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:18.294520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-98cab6b0-02ea-4cf4-9369-f851c7174add tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.253721 May 28 14:28:18.295472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 393/799] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:18 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:18.395961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6b6012da-7c3a-407b-910e-a2392e58a257 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1793117328"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:18.396609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6b6012da-7c3a-407b-910e-a2392e58a257 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:18.404781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b6012da-7c3a-407b-910e-a2392e58a257 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:18.405232 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b6012da-7c3a-407b-910e-a2392e58a257 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:18.406011 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b6012da-7c3a-407b-910e-a2392e58a257 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:18.406448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b6012da-7c3a-407b-910e-a2392e58a257 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:18.574782 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3e83e657-26b6-4502-9918-0054838a595d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:18.575701 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3e83e657-26b6-4502-9918-0054838a595d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:18.584367 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3e83e657-26b6-4502-9918-0054838a595d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:18.584830 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3e83e657-26b6-4502-9918-0054838a595d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:18.585630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3e83e657-26b6-4502-9918-0054838a595d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:18.592587 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3e83e657-26b6-4502-9918-0054838a595d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:18.604661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.network.security_group_api [None req-6b6012da-7c3a-407b-910e-a2392e58a257 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Adding security group 3d863428-3f5e-4b80-a607-bbb4325e640a to port 164fd7c8-7a57-4285-93ef-c3fdabceb8be May 28 14:28:18.712456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3e83e657-26b6-4502-9918-0054838a595d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:18.721351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3e83e657-26b6-4502-9918-0054838a595d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.150726 May 28 14:28:18.721934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 394/800] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:18 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:18.726194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:18.726805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:18.734959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:18.734959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:18.736354 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:18.736354 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:18.947685 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:18.957009 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.234021 May 28 14:28:18.957687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 395/801] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:18 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:19.290786 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6b6012da-7c3a-407b-910e-a2392e58a257 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/action" status: 202 len: 0 microversion: 2.1 time: 0.898518 May 28 14:28:19.292581 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 407/802] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:28:18 2021] POST /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/action => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:28:19.312755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-491e1683-e54d-4614-b5c7-c7cf845ce24e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4", "tag": "164fd7c8-7a57-4285-93ef-c3fdabceb8be"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:19.314381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d0b524e6-637b-4196-b211-2468ee8477e7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:19.315437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d0b524e6-637b-4196-b211-2468ee8477e7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:19.318765 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:19.318765 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:28:19.325686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d0b524e6-637b-4196-b211-2468ee8477e7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.332367 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d0b524e6-637b-4196-b211-2468ee8477e7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:19.332367 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d0b524e6-637b-4196-b211-2468ee8477e7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.332367 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d0b524e6-637b-4196-b211-2468ee8477e7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:19.332692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-491e1683-e54d-4614-b5c7-c7cf845ce24e service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.332692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-491e1683-e54d-4614-b5c7-c7cf845ce24e service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:19.353927 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-491e1683-e54d-4614-b5c7-c7cf845ce24e service nova] Creating event network-changed:164fd7c8-7a57-4285-93ef-c3fdabceb8be for instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 on hv-cinder-79128 May 28 14:28:19.360178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-491e1683-e54d-4614-b5c7-c7cf845ce24e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055192 May 28 14:28:19.361409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 408/803] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:28:19.367164 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:19.368300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:19.378336 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.380870 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:19.381908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.382809 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:19.674047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:19.688015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:19.693333 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:19.693333 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.327835 May 28 14:28:19.693333 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 409/804] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:19 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:19.738587 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-990fecd6-0016-440d-b47c-aa1c7b073a07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:19.739250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-990fecd6-0016-440d-b47c-aa1c7b073a07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:19.753345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d0b524e6-637b-4196-b211-2468ee8477e7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:19.753953 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-990fecd6-0016-440d-b47c-aa1c7b073a07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.753953 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-990fecd6-0016-440d-b47c-aa1c7b073a07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:19.754506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-990fecd6-0016-440d-b47c-aa1c7b073a07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.755227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-990fecd6-0016-440d-b47c-aa1c7b073a07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:19.762216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d0b524e6-637b-4196-b211-2468ee8477e7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1642 microversion: 2.1 time: 0.463958 May 28 14:28:19.763193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 396/805] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:19 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1642 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:19.905594 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-990fecd6-0016-440d-b47c-aa1c7b073a07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:19.917168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-990fecd6-0016-440d-b47c-aa1c7b073a07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.182268 May 28 14:28:19.917887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 410/806] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:19 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:19.975029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a346cf31-83cf-45f0-a481-8e72a4c0da7e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:19.975974 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a346cf31-83cf-45f0-a481-8e72a4c0da7e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:19.988358 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a346cf31-83cf-45f0-a481-8e72a4c0da7e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.988817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a346cf31-83cf-45f0-a481-8e72a4c0da7e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:19.989610 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a346cf31-83cf-45f0-a481-8e72a4c0da7e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:19.990049 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a346cf31-83cf-45f0-a481-8e72a4c0da7e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:20.200594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a346cf31-83cf-45f0-a481-8e72a4c0da7e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:20.210055 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a346cf31-83cf-45f0-a481-8e72a4c0da7e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.239623 May 28 14:28:20.210939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 397/807] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:19 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:20.710282 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:20.711191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:20.728284 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:20.728950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:20.729528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:20.729966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:20.934975 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:20.935744 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:20.942298 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:20.943533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:20.944156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:20.945090 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:20.945617 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:20.952072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:20.953585 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:20.954758 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-99348937-1feb-488a-9cef-d93bfbb45fd2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.248257 May 28 14:28:20.955312 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 411/808] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:20 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:21.064675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:21.072892 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.142464 May 28 14:28:21.073450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 398/809] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:20 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:21.229806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ab7861ed-5524-4331-b92f-0931c175b181 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:21.230417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ab7861ed-5524-4331-b92f-0931c175b181 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:21.237866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ab7861ed-5524-4331-b92f-0931c175b181 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:21.238280 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ab7861ed-5524-4331-b92f-0931c175b181 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:21.239054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ab7861ed-5524-4331-b92f-0931c175b181 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:21.239492 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ab7861ed-5524-4331-b92f-0931c175b181 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:21.454059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ab7861ed-5524-4331-b92f-0931c175b181 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:21.462224 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ab7861ed-5524-4331-b92f-0931c175b181 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.236748 May 28 14:28:21.462786 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 412/810] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:21 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:21.975005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:21.975700 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:21.983695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:21.984151 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:21.984933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:21.985372 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:22.090871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f5f227f7-e6d8-4252-9626-44d059073d62 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:22.091669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f5f227f7-e6d8-4252-9626-44d059073d62 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:22.099008 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5f227f7-e6d8-4252-9626-44d059073d62 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:22.099457 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5f227f7-e6d8-4252-9626-44d059073d62 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:22.100278 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5f227f7-e6d8-4252-9626-44d059073d62 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:22.100719 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5f227f7-e6d8-4252-9626-44d059073d62 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:22.208095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:22.221214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:22.222750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:22.223423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f5f227f7-e6d8-4252-9626-44d059073d62 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:22.223939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.252701 May 28 14:28:22.224560 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 399/811] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:21 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:22.233048 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f5f227f7-e6d8-4252-9626-44d059073d62 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.146389 May 28 14:28:22.233636 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 413/812] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:22 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:22.480027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:22.488970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:22.488970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:22.488970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:22.489425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:22.489608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:22.698402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:22.706586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.230848 May 28 14:28:22.707166 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 400/813] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:22 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:23.242979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:23.245865 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:23.256730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-41e7ee28-6b67-4886-8486-009ff83b70af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:23.257919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-41e7ee28-6b67-4886-8486-009ff83b70af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:23.260011 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:23.260635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:23.261426 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:23.261932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:23.269048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41e7ee28-6b67-4886-8486-009ff83b70af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:23.269536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41e7ee28-6b67-4886-8486-009ff83b70af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:23.270376 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41e7ee28-6b67-4886-8486-009ff83b70af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:23.270803 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41e7ee28-6b67-4886-8486-009ff83b70af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:23.393369 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-41e7ee28-6b67-4886-8486-009ff83b70af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:23.402485 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-41e7ee28-6b67-4886-8486-009ff83b70af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.149709 May 28 14:28:23.403068 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 401/814] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:23 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:23.480243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:23.490349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:23.491922 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:23.493198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8954c002-6d7b-430e-8639-7715d7b84d10 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.254190 May 28 14:28:23.503112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 414/815] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:23 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:23.724316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:23.725207 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:23.733695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:23.734400 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:23.735326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:23.735950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:23.952064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:23.960785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.240320 May 28 14:28:23.961349 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 402/816] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:23 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:24.420067 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6151fbc1-31cf-4e8c-8584-1a24155706ca tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:24.420643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6151fbc1-31cf-4e8c-8584-1a24155706ca tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:24.428113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6151fbc1-31cf-4e8c-8584-1a24155706ca tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:24.428576 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6151fbc1-31cf-4e8c-8584-1a24155706ca tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:24.429379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6151fbc1-31cf-4e8c-8584-1a24155706ca tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:24.429826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6151fbc1-31cf-4e8c-8584-1a24155706ca tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:24.514044 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:24.515627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:24.522088 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:24.522542 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:24.523323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:24.523791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:24.551738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6151fbc1-31cf-4e8c-8584-1a24155706ca tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:24.562251 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6151fbc1-31cf-4e8c-8584-1a24155706ca tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.146563 May 28 14:28:24.563139 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 415/817] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:24 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:24.760557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:24.770160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:24.771929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:24.773118 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.262821 May 28 14:28:24.773743 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 403/818] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:24 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:24.978134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:24.978761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:24.986174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:24.986647 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:24.987441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:24.988001 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:25.208620 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:25.217656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.243217 May 28 14:28:25.218438 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 416/819] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:24 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:25.579641 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ca954c93-061d-41d7-8be4-927aa24c823c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:25.580280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ca954c93-061d-41d7-8be4-927aa24c823c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:25.588451 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca954c93-061d-41d7-8be4-927aa24c823c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:25.588908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca954c93-061d-41d7-8be4-927aa24c823c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:25.589775 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca954c93-061d-41d7-8be4-927aa24c823c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:25.590215 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca954c93-061d-41d7-8be4-927aa24c823c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:25.707204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca954c93-061d-41d7-8be4-927aa24c823c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:25.716383 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ca954c93-061d-41d7-8be4-927aa24c823c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.140552 May 28 14:28:25.723639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 404/820] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:25 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:25.791733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:25.792404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:25.799718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:25.800117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:25.800920 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:25.801363 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:26.012453 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:26.023307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:26.025364 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:26.026568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3b162441-6875-431e-b143-e1540172fede tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.238832 May 28 14:28:26.033574 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 417/821] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:25 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:26.234244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:26.234872 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:26.242582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:26.243035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:26.243868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:26.244318 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:26.479982 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:26.486541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.255912 May 28 14:28:26.487729 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 405/822] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:26 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:26.733967 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d9689862-fe2f-4871-bbbd-6e13a14ec04c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:26.761646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d9689862-fe2f-4871-bbbd-6e13a14ec04c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:26.761646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9689862-fe2f-4871-bbbd-6e13a14ec04c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:26.761646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9689862-fe2f-4871-bbbd-6e13a14ec04c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:26.761646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9689862-fe2f-4871-bbbd-6e13a14ec04c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:26.762148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9689862-fe2f-4871-bbbd-6e13a14ec04c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:26.864254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d9689862-fe2f-4871-bbbd-6e13a14ec04c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:26.876468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d9689862-fe2f-4871-bbbd-6e13a14ec04c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.146724 May 28 14:28:26.877480 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 418/823] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:26 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:27.054600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:27.055200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:27.062678 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:27.063135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:27.063955 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:27.064396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:27.281430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:27.294480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:27.296055 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:27.297250 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a0947e0f-5363-48f1-9487-281d0e674621 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.246462 May 28 14:28:27.298015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 406/824] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:27 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:27.505248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b7576e40-3f42-4f63-9de8-a46154ab84b0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:27.505874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b7576e40-3f42-4f63-9de8-a46154ab84b0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:27.513597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b7576e40-3f42-4f63-9de8-a46154ab84b0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:27.514052 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b7576e40-3f42-4f63-9de8-a46154ab84b0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:27.514840 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b7576e40-3f42-4f63-9de8-a46154ab84b0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:27.515275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b7576e40-3f42-4f63-9de8-a46154ab84b0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:27.724605 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b7576e40-3f42-4f63-9de8-a46154ab84b0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:27.733361 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b7576e40-3f42-4f63-9de8-a46154ab84b0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.232504 May 28 14:28:27.734130 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 419/825] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:27 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:27.893531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:27.894169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:27.902285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:27.902734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:27.903521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:27.904008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:28.031880 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:28.040043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.150304 May 28 14:28:28.040650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 407/826] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:27 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:28.316613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:28.317379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:28.326296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:28.326756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:28.327598 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:28.328047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:28.525452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:28.535077 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:28.536873 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:28.538236 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-65043b52-c345-43ae-8457-7cf6e5f51d06 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.225528 May 28 14:28:28.539012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 420/827] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:28 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:28.751531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6a259753-ae03-41f6-92a7-db0c62a6bae7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:28.752229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6a259753-ae03-41f6-92a7-db0c62a6bae7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:28.760729 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6a259753-ae03-41f6-92a7-db0c62a6bae7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:28.761179 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6a259753-ae03-41f6-92a7-db0c62a6bae7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:28.762135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6a259753-ae03-41f6-92a7-db0c62a6bae7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:28.762572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6a259753-ae03-41f6-92a7-db0c62a6bae7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:28.969459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6a259753-ae03-41f6-92a7-db0c62a6bae7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:28.978696 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6a259753-ae03-41f6-92a7-db0c62a6bae7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.231053 May 28 14:28:28.979294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 408/828] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:28 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:29.058708 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:29.059363 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:29.067251 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:29.067742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:29.068549 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:29.068995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:29.190599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:29.199461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.145478 May 28 14:28:29.200080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 421/829] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:29 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:29.558423 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:29.559182 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:29.567491 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:29.568242 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:29.569071 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:29.569527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:29.866131 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:29.876403 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:29.877942 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:29.879090 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ae4f8948-aa82-4788-a8ea-db27602f3d89 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.325640 May 28 14:28:29.879718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 409/830] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:29 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:29.998168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0a188032-c197-45ed-8483-251170cfe6a3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:29.998790 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0a188032-c197-45ed-8483-251170cfe6a3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:30.006241 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a188032-c197-45ed-8483-251170cfe6a3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:30.006700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a188032-c197-45ed-8483-251170cfe6a3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:30.007489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a188032-c197-45ed-8483-251170cfe6a3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:30.008126 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a188032-c197-45ed-8483-251170cfe6a3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:30.218472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ae8632ee-1628-420a-b3f1-132962477a51 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:30.218752 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0a188032-c197-45ed-8483-251170cfe6a3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:30.219537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ae8632ee-1628-420a-b3f1-132962477a51 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:30.227308 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0a188032-c197-45ed-8483-251170cfe6a3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.234642 May 28 14:28:30.228262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 422/831] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:29 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:30.233554 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae8632ee-1628-420a-b3f1-132962477a51 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:30.234019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae8632ee-1628-420a-b3f1-132962477a51 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:30.238633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae8632ee-1628-420a-b3f1-132962477a51 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:30.239158 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae8632ee-1628-420a-b3f1-132962477a51 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:30.354185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ae8632ee-1628-420a-b3f1-132962477a51 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:30.362860 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ae8632ee-1628-420a-b3f1-132962477a51 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.149037 May 28 14:28:30.363437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 410/832] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:30 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:30.898221 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:30.898783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:30.906418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:30.906913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:30.907794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:30.908342 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:31.244184 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:31.245069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:31.252945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:31.253532 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:31.254407 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:31.255589 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:31.257533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:31.268172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:31.269811 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:31.271267 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ddcc0652-3cbb-4252-a00f-9a514091476f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.376752 May 28 14:28:31.282622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 423/833] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:30 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:31.380010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-90e67871-ed40-4696-b1df-a68ead8d08a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:31.380880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-90e67871-ed40-4696-b1df-a68ead8d08a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:31.394785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-90e67871-ed40-4696-b1df-a68ead8d08a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:31.396269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-90e67871-ed40-4696-b1df-a68ead8d08a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:31.397485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-90e67871-ed40-4696-b1df-a68ead8d08a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:31.398114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-90e67871-ed40-4696-b1df-a68ead8d08a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:31.488492 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:31.497896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.257441 May 28 14:28:31.499100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 411/834] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:31 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:31.529510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-90e67871-ed40-4696-b1df-a68ead8d08a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:31.537624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-90e67871-ed40-4696-b1df-a68ead8d08a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.161762 May 28 14:28:31.538183 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 424/835] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:31 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:32.293177 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:32.293890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:32.304327 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:32.304817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:32.305947 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:32.306387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:32.521497 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e9cc6bba-94b8-4575-9d57-74a026c227cd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:32.522153 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e9cc6bba-94b8-4575-9d57-74a026c227cd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:32.532103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e9cc6bba-94b8-4575-9d57-74a026c227cd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:32.543583 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:32.545640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e9cc6bba-94b8-4575-9d57-74a026c227cd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:32.546649 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e9cc6bba-94b8-4575-9d57-74a026c227cd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:32.547118 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e9cc6bba-94b8-4575-9d57-74a026c227cd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:32.557035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:32.558814 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:32.560317 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f06e25aa-8968-4958-babb-200396ea1ec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.272116 May 28 14:28:32.561290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 412/836] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:32 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:32.566275 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-282eb6df-a33a-40d2-a237-26d03bd92a42 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:32.567259 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-282eb6df-a33a-40d2-a237-26d03bd92a42 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:32.581690 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-282eb6df-a33a-40d2-a237-26d03bd92a42 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:32.582343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-282eb6df-a33a-40d2-a237-26d03bd92a42 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:32.583220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-282eb6df-a33a-40d2-a237-26d03bd92a42 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:32.583797 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-282eb6df-a33a-40d2-a237-26d03bd92a42 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:32.706777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-282eb6df-a33a-40d2-a237-26d03bd92a42 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:32.715856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-282eb6df-a33a-40d2-a237-26d03bd92a42 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.153388 May 28 14:28:32.716476 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 413/837] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:32 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:32.782866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e9cc6bba-94b8-4575-9d57-74a026c227cd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:32.791945 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e9cc6bba-94b8-4575-9d57-74a026c227cd tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.274704 May 28 14:28:32.792542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 425/838] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:32 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:33.578514 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:33.579125 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:33.586448 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:33.586915 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:33.588282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:33.588726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:33.732985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a4d4707a-d8a7-4555-a919-0ddf00301995 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:33.733626 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a4d4707a-d8a7-4555-a919-0ddf00301995 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:33.740970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a4d4707a-d8a7-4555-a919-0ddf00301995 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:33.741362 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a4d4707a-d8a7-4555-a919-0ddf00301995 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:33.742157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a4d4707a-d8a7-4555-a919-0ddf00301995 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:33.742601 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a4d4707a-d8a7-4555-a919-0ddf00301995 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:33.791473 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:33.801730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:33.803533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:33.804798 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e81a9a63-522c-430a-ab58-3c1aea89c0bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.230067 May 28 14:28:33.805370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 414/839] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:33 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:33.809989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1c490406-c325-45dd-b04f-42048ecff26a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:33.810614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1c490406-c325-45dd-b04f-42048ecff26a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:33.818091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c490406-c325-45dd-b04f-42048ecff26a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:33.818575 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c490406-c325-45dd-b04f-42048ecff26a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:33.819377 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c490406-c325-45dd-b04f-42048ecff26a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:33.819845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c490406-c325-45dd-b04f-42048ecff26a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:33.864817 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a4d4707a-d8a7-4555-a919-0ddf00301995 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:33.873889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a4d4707a-d8a7-4555-a919-0ddf00301995 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.144600 May 28 14:28:33.874511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 426/840] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:33 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:34.023149 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1c490406-c325-45dd-b04f-42048ecff26a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:34.032165 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1c490406-c325-45dd-b04f-42048ecff26a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.225786 May 28 14:28:34.032750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 415/841] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:33 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:34.822198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:34.822713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:34.830192 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:34.830643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:34.831451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:34.831925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:34.890188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2d0df656-8294-4b03-83b5-c141967e42da tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:34.894285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2d0df656-8294-4b03-83b5-c141967e42da tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:34.898283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2d0df656-8294-4b03-83b5-c141967e42da tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:34.898683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2d0df656-8294-4b03-83b5-c141967e42da tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:34.899463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2d0df656-8294-4b03-83b5-c141967e42da tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:34.901938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2d0df656-8294-4b03-83b5-c141967e42da tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:35.012682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2d0df656-8294-4b03-83b5-c141967e42da tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:35.021046 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2d0df656-8294-4b03-83b5-c141967e42da tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1304 microversion: 2.1 time: 0.134454 May 28 14:28:35.021627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 416/842] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:34 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:35.031702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:35.041871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:35.043443 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:35.044758 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-069950a2-8d65-4940-a66d-485024600e33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.226372 May 28 14:28:35.045283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 427/843] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:34 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:35.048719 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0a5824ed-14f7-4447-a740-b0b992e435a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:35.049758 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0a5824ed-14f7-4447-a740-b0b992e435a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:35.057289 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a5824ed-14f7-4447-a740-b0b992e435a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:35.057743 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a5824ed-14f7-4447-a740-b0b992e435a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:35.058518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a5824ed-14f7-4447-a740-b0b992e435a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:35.058954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a5824ed-14f7-4447-a740-b0b992e435a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:35.262183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0a5824ed-14f7-4447-a740-b0b992e435a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:35.270581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0a5824ed-14f7-4447-a740-b0b992e435a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.225549 May 28 14:28:35.271083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 417/844] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:35 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:36.038158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:36.038769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:36.046564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:36.047027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:36.047874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:36.048349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:36.062873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:36.063825 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:36.071243 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:36.071855 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:36.072736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:36.073271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:36.123242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:36.123789 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:36.124349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lazy-loading 'fault' on Instance uuid 031d9ce3-9559-48b6-b92f-47ac210b74be {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:28:36.245117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:36.253936 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c1c7de0b-f129-4da8-9137-d884cd1fd667 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 200 len: 1309 microversion: 2.1 time: 0.219485 May 28 14:28:36.254739 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 428/845] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:36 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 1309 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:36.278053 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:36.287058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-33703959-7c44-4da4-9599-a986861defcb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:36.287709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-33703959-7c44-4da4-9599-a986861defcb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:36.290954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:36.291230 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:36.292548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-859a2fd9-9dc9-47f4-908d-f37071fd0325 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.233462 May 28 14:28:36.293115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 418/846] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:36 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:36.295472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33703959-7c44-4da4-9599-a986861defcb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:36.295992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33703959-7c44-4da4-9599-a986861defcb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:36.297002 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33703959-7c44-4da4-9599-a986861defcb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:36.297443 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33703959-7c44-4da4-9599-a986861defcb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:36.788206 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-33703959-7c44-4da4-9599-a986861defcb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:36.797992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-33703959-7c44-4da4-9599-a986861defcb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.514486 May 28 14:28:36.798757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 429/847] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:36 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:37.272559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:37.273187 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: 031d9ce3-9559-48b6-b92f-47ac210b74be] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:37.281075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:37.281528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:37.282415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:37.282846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:37.317099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:37.320579 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:37.332526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:37.333128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:37.334508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:37.335059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:37.370651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] HTTP exception thrown: Instance 031d9ce3-9559-48b6-b92f-47ac210b74be could not be found. May 28 14:28:37.371195 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Returning 404 to user: Instance 031d9ce3-9559-48b6-b92f-47ac210b74be could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:28:37.372110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8db84feb-9a71-4803-85d5-64054532edf8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be" status: 404 len: 111 microversion: 2.1 time: 0.103922 May 28 14:28:37.373007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 419/848] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:37 2021] GET /compute/v2.1/servers/031d9ce3-9559-48b6-b92f-47ac210b74be => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:28:37.559507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:37.574253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:37.574253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:37.574253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-67442c5f-b953-403e-b766-86d70bd269c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.263419 May 28 14:28:37.574651 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 430/849] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:37 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:37.817202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:37.817993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:37.825209 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:37.825594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:37.826380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:37.826826 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:38.035327 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:38.044165 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.230568 May 28 14:28:38.044736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 420/850] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:37 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:38.271759 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-874388492", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "37e18bf5-545d-49a2-afdf-585587a7907f"}]}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:38.350129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] validate_networks() for [('37e18bf5-545d-49a2-afdf-585587a7907f', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:28:38.592276 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:38.592940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:38.600417 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:38.600875 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:38.601659 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:38.602404 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:38.818776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:38.834873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:38.836793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:38.838500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d7557870-a7ba-47cf-a3a5-6a5655611e1d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.250787 May 28 14:28:38.839338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 421/851] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:38 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:38.924798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:28:38.925529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:28:38.926026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:28:38.926453 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:28:38.926878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:28:38.943372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:38.943875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:38.944711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:38.945161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:38.964685 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Getting quotas for project 94dc9f7ad5dd40429991c68c00e7ec6d. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:28:38.968948 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Getting quotas for user d9be4db3bc1f4c2386bacaee2c9232ea and project 94dc9f7ad5dd40429991c68c00e7ec6d. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:28:38.980545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:28:38.982745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:28:39.060701 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:39.061262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:39.069510 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:39.069973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:39.070772 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:39.071300 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:39.098265 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4c9ee261-434e-444f-8980-f20ea1f4a7ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830470 May 28 14:28:39.099646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 431/852] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:28:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:28:39.113067 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-40aeea59-6a38-4192-a7dd-b5ed533668b2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:39.114000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-40aeea59-6a38-4192-a7dd-b5ed533668b2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:39.229356 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-40aeea59-6a38-4192-a7dd-b5ed533668b2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:39.247509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-40aeea59-6a38-4192-a7dd-b5ed533668b2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1217 microversion: 2.1 time: 0.138245 May 28 14:28:39.258616 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 432/853] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:39 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:39.318538 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:39.327574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.271199 May 28 14:28:39.328150 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 422/854] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:39 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:39.861493 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:39.862130 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:39.870238 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:39.871248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:39.871647 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:39.872088 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:40.068107 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:40.077664 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:40.079189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:40.080356 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1359dc20-8d6d-4c53-b979-c2a566c336a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.222684 May 28 14:28:40.080932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 433/855] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:39 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:40.265627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-16d88889-5dba-4e33-9de0-b8ae795990aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:40.266227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-16d88889-5dba-4e33-9de0-b8ae795990aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:40.273638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16d88889-5dba-4e33-9de0-b8ae795990aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:40.274107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16d88889-5dba-4e33-9de0-b8ae795990aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:40.274943 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16d88889-5dba-4e33-9de0-b8ae795990aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:40.275389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-16d88889-5dba-4e33-9de0-b8ae795990aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:40.344363 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:40.344993 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:40.352635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:40.353714 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:40.354614 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:40.355082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:40.389082 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-16d88889-5dba-4e33-9de0-b8ae795990aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:40.398091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-16d88889-5dba-4e33-9de0-b8ae795990aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1221 microversion: 2.1 time: 0.136206 May 28 14:28:40.398690 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 423/856] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:40 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:40.589400 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:40.598886 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.258245 May 28 14:28:40.599452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 434/857] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:40 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:41.099236 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:41.099885 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:41.107690 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:41.108139 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:41.108941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:41.109365 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:41.314590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:41.323973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:41.325547 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:41.326743 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.231529 May 28 14:28:41.327301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 424/858] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:41 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:41.416204 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b25d4ea3-5552-4b69-bd39-ed05b578b45a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:41.416727 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b25d4ea3-5552-4b69-bd39-ed05b578b45a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:41.424398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b25d4ea3-5552-4b69-bd39-ed05b578b45a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:41.424900 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b25d4ea3-5552-4b69-bd39-ed05b578b45a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:41.425693 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b25d4ea3-5552-4b69-bd39-ed05b578b45a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:41.426163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b25d4ea3-5552-4b69-bd39-ed05b578b45a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:41.539725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b25d4ea3-5552-4b69-bd39-ed05b578b45a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:41.549901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b25d4ea3-5552-4b69-bd39-ed05b578b45a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1221 microversion: 2.1 time: 0.138478 May 28 14:28:41.550479 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 435/859] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:41 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:41.617479 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-649e73d2-4851-4e6d-9e5b-e3e4669617da tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:41.618128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-649e73d2-4851-4e6d-9e5b-e3e4669617da tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:41.625881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-649e73d2-4851-4e6d-9e5b-e3e4669617da tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:41.629969 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-649e73d2-4851-4e6d-9e5b-e3e4669617da tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:41.629969 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-649e73d2-4851-4e6d-9e5b-e3e4669617da tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:41.629969 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-649e73d2-4851-4e6d-9e5b-e3e4669617da tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:41.826644 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-649e73d2-4851-4e6d-9e5b-e3e4669617da tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:41.835126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-649e73d2-4851-4e6d-9e5b-e3e4669617da tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.221670 May 28 14:28:41.835902 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 425/860] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:41 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:42.346490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:42.347103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:42.355064 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:42.355503 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:42.356308 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:42.356757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:42.556803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:42.566507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:42.567425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f9233a78-c764-4fea-b937-1f2dbac21f15 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:42.568123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f9233a78-c764-4fea-b937-1f2dbac21f15 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:42.568237 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:42.569283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-404092ba-b02c-4044-b271-46fee4182172 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.226622 May 28 14:28:42.569831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 436/861] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:42 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:42.576523 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f9233a78-c764-4fea-b937-1f2dbac21f15 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:42.577067 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f9233a78-c764-4fea-b937-1f2dbac21f15 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:42.577793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f9233a78-c764-4fea-b937-1f2dbac21f15 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:42.578238 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f9233a78-c764-4fea-b937-1f2dbac21f15 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:42.689133 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f9233a78-c764-4fea-b937-1f2dbac21f15 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:42.697971 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f9233a78-c764-4fea-b937-1f2dbac21f15 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1213 microversion: 2.1 time: 0.134440 May 28 14:28:42.698539 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 426/862] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:42 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:42.851679 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:42.852304 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:42.859661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:42.860126 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:42.860915 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:42.861393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:43.057620 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:43.065732 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.217815 May 28 14:28:43.066331 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 437/863] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:42 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:43.589186 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:43.589783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:43.598312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:43.598774 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:43.599638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:43.600083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:43.715743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:43.716378 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:43.723675 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:43.724143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:43.724939 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:43.725390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:43.807520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:43.818175 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:43.819719 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:43.820859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.236558 May 28 14:28:43.822067 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 427/864] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:43 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:43.844288 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:43.852447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1269 microversion: 2.1 time: 0.141330 May 28 14:28:43.853016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 438/865] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:43 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:44.082198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2e6de598-5f45-429b-9842-54f02f749d28 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:44.082825 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2e6de598-5f45-429b-9842-54f02f749d28 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:44.092284 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e6de598-5f45-429b-9842-54f02f749d28 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:44.092697 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e6de598-5f45-429b-9842-54f02f749d28 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:44.093557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e6de598-5f45-429b-9842-54f02f749d28 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:44.094007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e6de598-5f45-429b-9842-54f02f749d28 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:44.299957 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2e6de598-5f45-429b-9842-54f02f749d28 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:44.308742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2e6de598-5f45-429b-9842-54f02f749d28 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.230240 May 28 14:28:44.309540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 428/866] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:44 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:44.838875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:44.839506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:44.846831 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:44.847285 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:44.848108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:44.848547 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:44.869383 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:44.870031 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:44.880933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:44.881400 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:44.882188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:44.888229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:45.012163 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:45.021374 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1287 microversion: 2.1 time: 0.155531 May 28 14:28:45.021984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 429/867] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:44 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:45.238823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:45.250028 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:45.251582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:45.252741 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-799fe505-85e1-40d5-a5d2-0bf0c3991159 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.418174 May 28 14:28:45.253309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 439/868] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:44 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:45.325832 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:45.326595 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:45.333778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:45.334234 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:45.335010 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:45.335450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:45.538891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:45.547689 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.225686 May 28 14:28:45.556325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 430/869] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:45 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:46.039471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-39f2b473-cff4-48c3-90db-b9c9fce1270e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:46.040147 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-39f2b473-cff4-48c3-90db-b9c9fce1270e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:46.047412 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-39f2b473-cff4-48c3-90db-b9c9fce1270e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:46.050543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-39f2b473-cff4-48c3-90db-b9c9fce1270e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:46.050543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-39f2b473-cff4-48c3-90db-b9c9fce1270e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:46.050543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-39f2b473-cff4-48c3-90db-b9c9fce1270e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:46.270698 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:46.271277 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:46.279184 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:46.279609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:46.280398 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:46.280838 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:46.527911 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-39f2b473-cff4-48c3-90db-b9c9fce1270e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:46.543878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-39f2b473-cff4-48c3-90db-b9c9fce1270e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.508043 May 28 14:28:46.544814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 440/870] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:46 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:46.565137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a343430a-5567-47bb-8ad2-c87163239694 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:46.565978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a343430a-5567-47bb-8ad2-c87163239694 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:46.572177 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:46.574548 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a343430a-5567-47bb-8ad2-c87163239694 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:46.575111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a343430a-5567-47bb-8ad2-c87163239694 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:46.576071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a343430a-5567-47bb-8ad2-c87163239694 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:46.577169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a343430a-5567-47bb-8ad2-c87163239694 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:46.581854 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:46.583405 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:46.584650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e9e116fb-ef6e-4400-a905-bba2c79badad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.317780 May 28 14:28:46.585198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 431/871] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:46 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:46.985508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a343430a-5567-47bb-8ad2-c87163239694 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:46.993850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a343430a-5567-47bb-8ad2-c87163239694 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.432589 May 28 14:28:46.994756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 441/872] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:46 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:47.280171 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-121625e9-3d03-4f43-ab2c-8df59f1f0433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99f06a3-aa59-4312-820e-f3852cd77ac1", "tag": "827d9299-b0be-4acd-a8ae-13dd5fbf53f3"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:47.281970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:47.281970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:28:47.290873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-121625e9-3d03-4f43-ab2c-8df59f1f0433 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:47.293953 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-121625e9-3d03-4f43-ab2c-8df59f1f0433 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:47.313216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-121625e9-3d03-4f43-ab2c-8df59f1f0433 service nova] Creating event network-changed:827d9299-b0be-4acd-a8ae-13dd5fbf53f3 for instance d99f06a3-aa59-4312-820e-f3852cd77ac1 on hv-cinder-79128 May 28 14:28:47.318093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-121625e9-3d03-4f43-ab2c-8df59f1f0433 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041630 May 28 14:28:47.318684 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 432/873] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:28:47.562173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2f9ef797-dcdc-4292-b50a-3000da371a23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:47.562788 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2f9ef797-dcdc-4292-b50a-3000da371a23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:47.570287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2f9ef797-dcdc-4292-b50a-3000da371a23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:47.570752 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2f9ef797-dcdc-4292-b50a-3000da371a23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:47.571612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2f9ef797-dcdc-4292-b50a-3000da371a23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:47.572100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2f9ef797-dcdc-4292-b50a-3000da371a23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:47.603813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:47.604514 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:47.612051 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:47.612506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:47.613282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:47.613720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:47.771931 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2f9ef797-dcdc-4292-b50a-3000da371a23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:47.780843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2f9ef797-dcdc-4292-b50a-3000da371a23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.222290 May 28 14:28:47.781521 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 442/874] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:47 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:47.810392 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:47.822447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:47.824059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:47.825244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ad946536-12dd-4dd0-b804-0a4568f6ea34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.226296 May 28 14:28:47.825801 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 433/875] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:47 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:48.011039 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dddc48bd-0f69-4f17-be64-2460af927f20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:48.011666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-dddc48bd-0f69-4f17-be64-2460af927f20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:48.018964 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dddc48bd-0f69-4f17-be64-2460af927f20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:48.019419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dddc48bd-0f69-4f17-be64-2460af927f20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:48.020235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dddc48bd-0f69-4f17-be64-2460af927f20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:48.020680 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dddc48bd-0f69-4f17-be64-2460af927f20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:48.295211 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-dddc48bd-0f69-4f17-be64-2460af927f20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:48.303396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-dddc48bd-0f69-4f17-be64-2460af927f20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.296705 May 28 14:28:48.303983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 443/876] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:48 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:48.797886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b621f471-c7a8-4083-91f4-90cdbee1224b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:48.798635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b621f471-c7a8-4083-91f4-90cdbee1224b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:48.810897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b621f471-c7a8-4083-91f4-90cdbee1224b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:48.810897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b621f471-c7a8-4083-91f4-90cdbee1224b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:48.810897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b621f471-c7a8-4083-91f4-90cdbee1224b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:48.810897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b621f471-c7a8-4083-91f4-90cdbee1224b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:48.843875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:48.844656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:48.852718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:48.853630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:48.854427 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:48.854865 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:49.063579 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b621f471-c7a8-4083-91f4-90cdbee1224b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:49.075401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:49.082518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b621f471-c7a8-4083-91f4-90cdbee1224b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.287513 May 28 14:28:49.085594 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:49.087537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 434/877] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:48 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:49.087743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:49.088954 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7c49c245-4d07-4f0f-a89d-6e47d6086588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.249418 May 28 14:28:49.089505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 444/878] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:48 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:49.104914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-d34d9741-90c4-443f-816d-bf8db19c3613 req-5cf21de6-8938-4688-a911-5049e8806889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770", "name": "network-vif-plugged", "status": "completed", "tag": "2ed41bb3-bd69-4be3-a916-04232779f1d0"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:49.104914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:49.104914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:28:49.109908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-d34d9741-90c4-443f-816d-bf8db19c3613 req-5cf21de6-8938-4688-a911-5049e8806889 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:49.110355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-d34d9741-90c4-443f-816d-bf8db19c3613 req-5cf21de6-8938-4688-a911-5049e8806889 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:49.126941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-d34d9741-90c4-443f-816d-bf8db19c3613 req-5cf21de6-8938-4688-a911-5049e8806889 service nova] Creating event network-vif-plugged:2ed41bb3-bd69-4be3-a916-04232779f1d0 for instance 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 on hv-cinder-79128 May 28 14:28:49.131639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-d34d9741-90c4-443f-816d-bf8db19c3613 req-5cf21de6-8938-4688-a911-5049e8806889 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042538 May 28 14:28:49.133078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 435/879] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:28:49.320698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ceb1d1b1-d758-4310-98f3-9511ef38e418 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:49.321312 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ceb1d1b1-d758-4310-98f3-9511ef38e418 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:49.328942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ceb1d1b1-d758-4310-98f3-9511ef38e418 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:49.329401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ceb1d1b1-d758-4310-98f3-9511ef38e418 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:49.330235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ceb1d1b1-d758-4310-98f3-9511ef38e418 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:49.330689 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ceb1d1b1-d758-4310-98f3-9511ef38e418 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:49.603210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ceb1d1b1-d758-4310-98f3-9511ef38e418 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:49.613065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ceb1d1b1-d758-4310-98f3-9511ef38e418 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.296017 May 28 14:28:49.613652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 445/880] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:49 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:50.098951 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-50b5202e-7ad2-439c-a633-b82ee57944ab tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:50.099656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-50b5202e-7ad2-439c-a633-b82ee57944ab tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:50.106519 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:50.107139 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:50.109292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50b5202e-7ad2-439c-a633-b82ee57944ab tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:50.109849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50b5202e-7ad2-439c-a633-b82ee57944ab tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:50.110572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50b5202e-7ad2-439c-a633-b82ee57944ab tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:50.111023 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50b5202e-7ad2-439c-a633-b82ee57944ab tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:50.121300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:50.121759 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:50.122560 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:50.123033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:50.330706 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-50b5202e-7ad2-439c-a633-b82ee57944ab tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:50.335257 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:50.339153 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-50b5202e-7ad2-439c-a633-b82ee57944ab tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.244478 May 28 14:28:50.339764 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 436/881] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:50 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:50.345315 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:50.346972 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:50.348309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-87524676-750a-49b1-950f-8564ffa9be0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.246163 May 28 14:28:50.348913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 446/882] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:50 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:50.631991 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:50.633142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:50.640749 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:50.641216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:50.642010 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:50.642455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:50.838003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:50.846158 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.219691 May 28 14:28:50.846727 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 437/883] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:50 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:51.356387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9dad625a-96d5-45b3-af60-1c729ba96f27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:51.356924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9dad625a-96d5-45b3-af60-1c729ba96f27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:51.364243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9dad625a-96d5-45b3-af60-1c729ba96f27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:51.364700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9dad625a-96d5-45b3-af60-1c729ba96f27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:51.365478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9dad625a-96d5-45b3-af60-1c729ba96f27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:51.365929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9dad625a-96d5-45b3-af60-1c729ba96f27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:51.366055 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:51.366673 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:51.374258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:51.374671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:51.375440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:51.375902 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:51.589827 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9dad625a-96d5-45b3-af60-1c729ba96f27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:51.596199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:51.598813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9dad625a-96d5-45b3-af60-1c729ba96f27 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.246963 May 28 14:28:51.599535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 447/884] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:51 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:51.608996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:51.608996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:51.610342 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a6831763-863c-4002-b1cf-cb2b42ca340f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.247415 May 28 14:28:51.612107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 438/885] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:51 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:28:51.689029 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-669575056", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "8023cc33-82ed-49b2-a8e8-69839a1ff66e"}]}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:51.755151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] validate_networks() for [('8023cc33-82ed-49b2-a8e8-69839a1ff66e', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:28:51.862241 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:51.862769 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:51.871046 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:51.871500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:51.872305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:51.872771 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:52.068229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:52.076432 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.218045 May 28 14:28:52.077005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 439/886] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:51 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:52.625402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-06db3e2a-172e-40ce-9be4-58f0aa42253c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:52.626013 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-06db3e2a-172e-40ce-9be4-58f0aa42253c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:52.633527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-06db3e2a-172e-40ce-9be4-58f0aa42253c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:52.633919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-06db3e2a-172e-40ce-9be4-58f0aa42253c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:52.634718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-06db3e2a-172e-40ce-9be4-58f0aa42253c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:52.635166 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-06db3e2a-172e-40ce-9be4-58f0aa42253c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:52.654093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:28:52.654563 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:28:52.654991 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:28:52.655403 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:28:52.655844 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:28:52.664447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:52.664910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:52.665729 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:52.666174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:52.684269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Getting quotas for project 1db248e02dac49bf8688658eb42ee752. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:28:52.688071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Getting quotas for user 78113dc875a548d287a236802e0d6a0d and project 1db248e02dac49bf8688658eb42ee752. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:28:52.698605 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:28:52.700867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:28:52.816706 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131356 May 28 14:28:52.822628 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 448/887] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:28:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:28:52.827335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:52.827982 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:52.844179 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-06db3e2a-172e-40ce-9be4-58f0aa42253c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:52.844643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:52.845109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:52.845915 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:52.846362 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:52.852465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-06db3e2a-172e-40ce-9be4-58f0aa42253c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.231150 May 28 14:28:52.853249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 440/888] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:52 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:52.858195 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-40f2101c-90c1-4243-a4b5-13a81b46a20f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:52.858806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-40f2101c-90c1-4243-a4b5-13a81b46a20f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:52.929155 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-40f2101c-90c1-4243-a4b5-13a81b46a20f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:52.937999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-40f2101c-90c1-4243-a4b5-13a81b46a20f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1218 microversion: 2.1 time: 0.083696 May 28 14:28:52.939771 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 441/889] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:52 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:53.054042 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:53.063807 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:53.065320 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:53.066582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e109a040-bfe0-4f18-bef5-ca753b395ac3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.242987 May 28 14:28:53.067137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 449/890] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:52 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:53.092882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:53.093493 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:53.101178 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:53.101742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:53.102518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:53.102986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:53.306450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:53.314763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1314 microversion: 2.1 time: 0.225525 May 28 14:28:53.315334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 442/891] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:53 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:53.869320 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:53.870001 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:53.877660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:53.878123 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:53.878924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:53.879370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:53.955057 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-42925d7f-5bd4-4546-975a-fa0eb54378f1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:53.955775 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-42925d7f-5bd4-4546-975a-fa0eb54378f1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:53.963321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-42925d7f-5bd4-4546-975a-fa0eb54378f1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:53.965328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-42925d7f-5bd4-4546-975a-fa0eb54378f1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:53.965328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-42925d7f-5bd4-4546-975a-fa0eb54378f1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:53.965630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-42925d7f-5bd4-4546-975a-fa0eb54378f1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:54.078625 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:54.079049 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-42925d7f-5bd4-4546-975a-fa0eb54378f1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:54.087329 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.221696 May 28 14:28:54.087734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-42925d7f-5bd4-4546-975a-fa0eb54378f1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1222 microversion: 2.1 time: 0.136370 May 28 14:28:54.088050 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 450/892] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:53 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:54.089072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 443/893] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:53 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:54.093394 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:54.094002 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:54.101071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:54.101524 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:54.102308 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:54.102740 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:54.308167 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:54.317443 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:54.318973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:54.320153 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8b635cd2-93cc-4246-8e44-9b7704ad592a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.230221 May 28 14:28:54.320719 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 451/894] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:54 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:54.332743 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-873fca3f-92fa-4e06-9ae7-92e384382dce tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:54.333406 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-873fca3f-92fa-4e06-9ae7-92e384382dce tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:54.342611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-873fca3f-92fa-4e06-9ae7-92e384382dce tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:54.343108 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-873fca3f-92fa-4e06-9ae7-92e384382dce tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:54.344008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-873fca3f-92fa-4e06-9ae7-92e384382dce tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:54.344512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-873fca3f-92fa-4e06-9ae7-92e384382dce tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:54.554742 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-873fca3f-92fa-4e06-9ae7-92e384382dce tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:54.563968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-873fca3f-92fa-4e06-9ae7-92e384382dce tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1463 microversion: 2.1 time: 0.235476 May 28 14:28:54.564559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 444/895] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:54 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1463 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:54.618517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-855dd373-f3c4-4feb-bbda-b56b815c7e0c req-3b11109b-686d-42c5-8ed2-3e5168051450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c36e73b-e6ab-4203-ada8-e971693460e2", "name": "network-vif-plugged", "status": "completed", "tag": "c2872b93-4077-4bc0-8619-140f73de2a3a"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:54.623729 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:54.623729 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:28:54.629270 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-855dd373-f3c4-4feb-bbda-b56b815c7e0c req-3b11109b-686d-42c5-8ed2-3e5168051450 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:54.629720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-855dd373-f3c4-4feb-bbda-b56b815c7e0c req-3b11109b-686d-42c5-8ed2-3e5168051450 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:54.640286 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:54.640908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:54.646749 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-855dd373-f3c4-4feb-bbda-b56b815c7e0c req-3b11109b-686d-42c5-8ed2-3e5168051450 service nova] Creating event network-vif-plugged:c2872b93-4077-4bc0-8619-140f73de2a3a for instance 2c36e73b-e6ab-4203-ada8-e971693460e2 on hv-cinder-79128 May 28 14:28:54.648274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:54.648795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:54.649647 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:54.650190 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:54.652298 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-855dd373-f3c4-4feb-bbda-b56b815c7e0c req-3b11109b-686d-42c5-8ed2-3e5168051450 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037537 May 28 14:28:54.652882 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 452/896] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:28:54.715322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:28:55.078497 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 204 len: 0 microversion: 2.1 time: 0.442530 May 28 14:28:55.079235 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 445/897] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:28:54 2021] DELETE /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 14:28:55.087777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cb732260-2179-4813-94a7-e58aa900b8f2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:55.089041 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cb732260-2179-4813-94a7-e58aa900b8f2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:55.096701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cb732260-2179-4813-94a7-e58aa900b8f2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:55.097164 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cb732260-2179-4813-94a7-e58aa900b8f2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:55.097925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cb732260-2179-4813-94a7-e58aa900b8f2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:55.099862 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cb732260-2179-4813-94a7-e58aa900b8f2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:55.105726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:55.106466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:55.114340 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:55.124022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:55.124022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:55.124022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:55.335392 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:55.344311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.243394 May 28 14:28:55.354521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 446/898] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:55 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:55.359578 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:55.360229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:55.368214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:55.368837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:55.370339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:55.371266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:55.502465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:55.516255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1278 microversion: 2.1 time: 0.159615 May 28 14:28:55.517258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 447/899] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:55 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:55.523026 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:55.524169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:55.532989 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cb732260-2179-4813-94a7-e58aa900b8f2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:55.533752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:55.534252 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:55.535041 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:55.535482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:55.542290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cb732260-2179-4813-94a7-e58aa900b8f2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1469 microversion: 2.1 time: 0.458563 May 28 14:28:55.542886 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 453/900] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:55 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1469 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:55.763019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:55.773273 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:55.774802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:55.776806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1223c015-6f90-461a-b8ae-af1f44e1452f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.257612 May 28 14:28:55.779775 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 448/901] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:55 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:56.361712 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d102144f-13d0-4aa5-8ef2-d10870671a2e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:56.362340 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d102144f-13d0-4aa5-8ef2-d10870671a2e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:56.370283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d102144f-13d0-4aa5-8ef2-d10870671a2e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:56.371027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d102144f-13d0-4aa5-8ef2-d10870671a2e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:56.371867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d102144f-13d0-4aa5-8ef2-d10870671a2e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:56.372335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d102144f-13d0-4aa5-8ef2-d10870671a2e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:56.534348 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:56.534979 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:56.543680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:56.544223 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:56.545035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:56.545484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:56.761421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:56.770089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.239640 May 28 14:28:56.770874 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 449/902] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:56 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:56.775197 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4206164b-296e-4b8d-a5e4-ae609d63e117 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:56.776777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4206164b-296e-4b8d-a5e4-ae609d63e117 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:56.785298 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4206164b-296e-4b8d-a5e4-ae609d63e117 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:56.785907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4206164b-296e-4b8d-a5e4-ae609d63e117 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:56.786721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4206164b-296e-4b8d-a5e4-ae609d63e117 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:56.787170 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4206164b-296e-4b8d-a5e4-ae609d63e117 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:56.831977 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d102144f-13d0-4aa5-8ef2-d10870671a2e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:56.840599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d102144f-13d0-4aa5-8ef2-d10870671a2e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.482489 May 28 14:28:56.841591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 454/903] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:56 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:56.847092 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:56.848034 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:56.857025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:56.857592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:56.858490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:56.859039 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:57.007191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4206164b-296e-4b8d-a5e4-ae609d63e117 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:57.016138 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4206164b-296e-4b8d-a5e4-ae609d63e117 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1469 microversion: 2.1 time: 0.244396 May 28 14:28:57.016721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 450/904] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:56 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1469 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:57.210028 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:57.220369 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:57.221896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:57.223453 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.380667 May 28 14:28:57.224056 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 455/905] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:56 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:57.787691 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-561d725b-7e76-4d8c-a624-013f864f7a1e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:57.788272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-561d725b-7e76-4d8c-a624-013f864f7a1e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:57.795933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-561d725b-7e76-4d8c-a624-013f864f7a1e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:57.796388 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-561d725b-7e76-4d8c-a624-013f864f7a1e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:57.797161 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-561d725b-7e76-4d8c-a624-013f864f7a1e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:57.797646 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-561d725b-7e76-4d8c-a624-013f864f7a1e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:57.858754 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:57.859651 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:57.867532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:57.868174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:57.869044 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:57.869596 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:58.007743 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-561d725b-7e76-4d8c-a624-013f864f7a1e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:58.017769 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-561d725b-7e76-4d8c-a624-013f864f7a1e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.233768 May 28 14:28:58.018967 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 451/906] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:57 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:58.026513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-e87c74cf-b7f8-4828-8782-39986919e33a req-e9f19813-a454-4915-b96c-d2c696d66798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa156ac4-b444-4c02-a917-602aa688fba6", "tag": "59657597-74b5-4611-a1d9-144ab84f71dc"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:28:58.028623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:28:58.028623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:28:58.046849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-e87c74cf-b7f8-4828-8782-39986919e33a req-e9f19813-a454-4915-b96c-d2c696d66798 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:58.047244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-e87c74cf-b7f8-4828-8782-39986919e33a req-e9f19813-a454-4915-b96c-d2c696d66798 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:58.065853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-e87c74cf-b7f8-4828-8782-39986919e33a req-e9f19813-a454-4915-b96c-d2c696d66798 service nova] Creating event network-changed:59657597-74b5-4611-a1d9-144ab84f71dc for instance aa156ac4-b444-4c02-a917-602aa688fba6 on hv-cinder-79128 May 28 14:28:58.071058 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-e87c74cf-b7f8-4828-8782-39986919e33a req-e9f19813-a454-4915-b96c-d2c696d66798 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050251 May 28 14:28:58.072481 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 452/907] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:28:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:28:58.077564 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a0e38392-dd75-4cfb-bad6-401880deb3ea tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:58.082013 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a0e38392-dd75-4cfb-bad6-401880deb3ea tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:58.086709 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0e38392-dd75-4cfb-bad6-401880deb3ea tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:58.086845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0e38392-dd75-4cfb-bad6-401880deb3ea tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:58.087722 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0e38392-dd75-4cfb-bad6-401880deb3ea tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:58.088690 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0e38392-dd75-4cfb-bad6-401880deb3ea tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:58.274249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:58.283590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.428552 May 28 14:28:58.284481 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 456/908] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:57 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:58.298202 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:58.299410 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:58.301778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a0e38392-dd75-4cfb-bad6-401880deb3ea tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:58.308393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:58.308903 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:58.309878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:58.310390 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:58.311747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a0e38392-dd75-4cfb-bad6-401880deb3ea tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1469 microversion: 2.1 time: 0.238243 May 28 14:28:58.312594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 453/909] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:58 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:58.914800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:58.925033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:58.926542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:58.927709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1808 microversion: 2.20 time: 0.634270 May 28 14:28:58.928301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 457/910] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:58 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1808 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:28:59.035239 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6de9dd58-8c66-48ee-88a0-6747c7a4262b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:59.035940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6de9dd58-8c66-48ee-88a0-6747c7a4262b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:59.049941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6de9dd58-8c66-48ee-88a0-6747c7a4262b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:59.049941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6de9dd58-8c66-48ee-88a0-6747c7a4262b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:59.049941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6de9dd58-8c66-48ee-88a0-6747c7a4262b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:59.049941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6de9dd58-8c66-48ee-88a0-6747c7a4262b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:59.301798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:59.302465 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:59.310658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:59.311380 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:59.312222 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:59.312676 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:59.415645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6de9dd58-8c66-48ee-88a0-6747c7a4262b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:59.424307 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6de9dd58-8c66-48ee-88a0-6747c7a4262b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.393220 May 28 14:28:59.425132 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 454/911] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:59 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:59.429323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:59.429993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:59.437988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:59.440235 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:59.440235 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:59.440235 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:59.555667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:59.565060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1427 microversion: 2.1 time: 0.139149 May 28 14:28:59.579814 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 455/912] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:59 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1427 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:28:59.814940 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:28:59.823196 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.525559 May 28 14:28:59.823803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 458/913] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:28:59 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:28:59.946774 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:28:59.948019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:28:59.955879 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:59.956588 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:59.957411 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:59.957856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.144981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-1dc51dbf-21b7-4b8a-8b54-9e2f6084aa1e req-bf32117a-43a1-4061-a92b-02506e6cf06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770", "name": "network-vif-deleted", "tag": "2ed41bb3-bd69-4be3-a916-04232779f1d0"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:00.147713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:29:00.147713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:29:00.158500 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-1dc51dbf-21b7-4b8a-8b54-9e2f6084aa1e req-bf32117a-43a1-4061-a92b-02506e6cf06c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.159187 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-1dc51dbf-21b7-4b8a-8b54-9e2f6084aa1e req-bf32117a-43a1-4061-a92b-02506e6cf06c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.177394 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-1dc51dbf-21b7-4b8a-8b54-9e2f6084aa1e req-bf32117a-43a1-4061-a92b-02506e6cf06c service nova] Creating event network-vif-deleted:2ed41bb3-bd69-4be3-a916-04232779f1d0 for instance 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 on hv-cinder-79128 May 28 14:29:00.183428 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-1dc51dbf-21b7-4b8a-8b54-9e2f6084aa1e req-bf32117a-43a1-4061-a92b-02506e6cf06c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043110 May 28 14:29:00.184063 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 459/914] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:29:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:29:00.254052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:00.264285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:00.265932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:00.267216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e19428ed-659e-491d-860f-d7a554b74a78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1795 microversion: 2.20 time: 0.324411 May 28 14:29:00.267900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 456/915] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:28:59 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1795 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:29:00.441387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bad24621-b776-4ba5-be53-52ab8d812026 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:00.442099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bad24621-b776-4ba5-be53-52ab8d812026 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:00.451869 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bad24621-b776-4ba5-be53-52ab8d812026 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.452332 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bad24621-b776-4ba5-be53-52ab8d812026 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.453128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bad24621-b776-4ba5-be53-52ab8d812026 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.453743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bad24621-b776-4ba5-be53-52ab8d812026 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.583636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:00.584487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:00.592665 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.593214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.597343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.597343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.666930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.667484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.668040 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lazy-loading 'fault' on Instance uuid 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:29:00.730839 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c16053fd78754225a5aa271b5ee84295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3794d25c6c34e459ce43288d19e5cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:00.742569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1e139706-16f4-440f-bff6-9d476c2f672a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 200 len: 1304 microversion: 2.1 time: 0.162933 May 28 14:29:00.752406 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 457/916] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:00 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:29:00.752723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bad24621-b776-4ba5-be53-52ab8d812026 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:00.755877 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-a859604a-c5b1-4031-9367-0a995b4834a3 req-1522c084-14cf-4441-b4df-c3d07cb831cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99f06a3-aa59-4312-820e-f3852cd77ac1", "name": "network-vif-plugged", "status": "completed", "tag": "827d9299-b0be-4acd-a8ae-13dd5fbf53f3"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:00.757452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:29:00.757452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:29:00.764347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bad24621-b776-4ba5-be53-52ab8d812026 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.327140 May 28 14:29:00.765168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 460/917] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:00 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:00.766087 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-a859604a-c5b1-4031-9367-0a995b4834a3 req-1522c084-14cf-4441-b4df-c3d07cb831cf service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.766541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-a859604a-c5b1-4031-9367-0a995b4834a3 req-1522c084-14cf-4441-b4df-c3d07cb831cf service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.782714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-a859604a-c5b1-4031-9367-0a995b4834a3 req-1522c084-14cf-4441-b4df-c3d07cb831cf service nova] Creating event network-vif-plugged:827d9299-b0be-4acd-a8ae-13dd5fbf53f3 for instance d99f06a3-aa59-4312-820e-f3852cd77ac1 on hv-cinder-79128 May 28 14:29:00.787286 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-a859604a-c5b1-4031-9367-0a995b4834a3 req-1522c084-14cf-4441-b4df-c3d07cb831cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042549 May 28 14:29:00.787904 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 458/918] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:29:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:29:00.840916 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-390498f5-2546-4520-8b89-fd63964cf1da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:00.845843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-390498f5-2546-4520-8b89-fd63964cf1da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:00.849609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-390498f5-2546-4520-8b89-fd63964cf1da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.850137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-390498f5-2546-4520-8b89-fd63964cf1da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:00.851013 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-390498f5-2546-4520-8b89-fd63964cf1da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:00.851544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-390498f5-2546-4520-8b89-fd63964cf1da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:01.074848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-390498f5-2546-4520-8b89-fd63964cf1da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:01.084433 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-390498f5-2546-4520-8b89-fd63964cf1da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.247957 May 28 14:29:01.085018 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 461/919] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:00 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:01.760033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:01.761397 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] [instance: 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:01.769107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:01.769559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:01.770335 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:01.770773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:01.781541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:01.782163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:01.789441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:01.789897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:01.790685 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:01.791134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:01.819007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] HTTP exception thrown: Instance 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 could not be found. May 28 14:29:01.819632 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Returning 404 to user: Instance 1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:29:01.820468 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-27dfa9e0-8ea4-498d-8496-4144c46b5a88 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770" status: 404 len: 111 microversion: 2.1 time: 0.065320 May 28 14:29:01.821027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 459/920] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:01 2021] GET /compute/v2.1/servers/1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:29:01.991952 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:02.000582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.222626 May 28 14:29:02.001175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 462/921] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:01 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:29:02.101302 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e7df8f30-f375-4b07-9786-87864117cb38 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:02.102019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e7df8f30-f375-4b07-9786-87864117cb38 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:02.109977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7df8f30-f375-4b07-9786-87864117cb38 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:02.110428 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7df8f30-f375-4b07-9786-87864117cb38 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:02.111206 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7df8f30-f375-4b07-9786-87864117cb38 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:02.111670 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e7df8f30-f375-4b07-9786-87864117cb38 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:02.309104 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e7df8f30-f375-4b07-9786-87864117cb38 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:02.317525 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e7df8f30-f375-4b07-9786-87864117cb38 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.219912 May 28 14:29:02.318088 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 460/922] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:02 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:03.017335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-673c017f-da25-474b-931f-bab49cb78d70 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:03.017959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-673c017f-da25-474b-931f-bab49cb78d70 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:03.025483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-673c017f-da25-474b-931f-bab49cb78d70 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:03.026677 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-673c017f-da25-474b-931f-bab49cb78d70 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:03.027471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-673c017f-da25-474b-931f-bab49cb78d70 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:03.027954 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-673c017f-da25-474b-931f-bab49cb78d70 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:03.240837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-673c017f-da25-474b-931f-bab49cb78d70 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:03.250656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-673c017f-da25-474b-931f-bab49cb78d70 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.237124 May 28 14:29:03.251330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 463/923] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:03 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:03.339585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:03.340195 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:03.347375 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:03.347851 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:03.348631 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:03.349073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:03.563789 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:03.572320 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1317 microversion: 2.1 time: 0.236906 May 28 14:29:03.578160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 461/924] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:03 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:04.267413 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-11aaf17b-0b43-4190-828b-0eaf63c60096 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:04.268065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-11aaf17b-0b43-4190-828b-0eaf63c60096 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:04.275340 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-11aaf17b-0b43-4190-828b-0eaf63c60096 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:04.277995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-11aaf17b-0b43-4190-828b-0eaf63c60096 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:04.277995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-11aaf17b-0b43-4190-828b-0eaf63c60096 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:04.277995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-11aaf17b-0b43-4190-828b-0eaf63c60096 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:04.502115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-11aaf17b-0b43-4190-828b-0eaf63c60096 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:04.510222 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-11aaf17b-0b43-4190-828b-0eaf63c60096 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.246543 May 28 14:29:04.510869 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 464/925] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:04 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:04.590127 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fb28e894-7814-4dfe-84b4-6679f2254e39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:04.590908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fb28e894-7814-4dfe-84b4-6679f2254e39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:04.598281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fb28e894-7814-4dfe-84b4-6679f2254e39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:04.598733 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fb28e894-7814-4dfe-84b4-6679f2254e39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:04.599509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fb28e894-7814-4dfe-84b4-6679f2254e39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:04.600017 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fb28e894-7814-4dfe-84b4-6679f2254e39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:04.795167 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-fb28e894-7814-4dfe-84b4-6679f2254e39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:04.803918 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fb28e894-7814-4dfe-84b4-6679f2254e39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1507 microversion: 2.1 time: 0.217746 May 28 14:29:04.804695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 462/926] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:04 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:05.533229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c0ccd83d-ebae-435a-9624-6636503bb689 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:05.533229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c0ccd83d-ebae-435a-9624-6636503bb689 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:05.539127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0ccd83d-ebae-435a-9624-6636503bb689 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:05.539603 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0ccd83d-ebae-435a-9624-6636503bb689 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:05.540395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0ccd83d-ebae-435a-9624-6636503bb689 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:05.540837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c0ccd83d-ebae-435a-9624-6636503bb689 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:05.771287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c0ccd83d-ebae-435a-9624-6636503bb689 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:05.780074 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c0ccd83d-ebae-435a-9624-6636503bb689 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.256673 May 28 14:29:05.780643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 465/927] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:05 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:06.777809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-6d8792a8-a360-4924-8d21-b9e23a13f816 req-06156a16-9fce-46f7-9126-8e20ccc1334a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa156ac4-b444-4c02-a917-602aa688fba6", "name": "network-vif-plugged", "status": "completed", "tag": "59657597-74b5-4611-a1d9-144ab84f71dc"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:06.779387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:29:06.779387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:29:06.787455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-6d8792a8-a360-4924-8d21-b9e23a13f816 req-06156a16-9fce-46f7-9126-8e20ccc1334a service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:06.793777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-6d8792a8-a360-4924-8d21-b9e23a13f816 req-06156a16-9fce-46f7-9126-8e20ccc1334a service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:06.797439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-58faf9a9-f430-4676-ac90-21e34a001a30 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:06.798117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-58faf9a9-f430-4676-ac90-21e34a001a30 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:06.804191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-6d8792a8-a360-4924-8d21-b9e23a13f816 req-06156a16-9fce-46f7-9126-8e20ccc1334a service nova] Creating event network-vif-plugged:59657597-74b5-4611-a1d9-144ab84f71dc for instance aa156ac4-b444-4c02-a917-602aa688fba6 on hv-cinder-79128 May 28 14:29:06.805723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58faf9a9-f430-4676-ac90-21e34a001a30 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:06.806183 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58faf9a9-f430-4676-ac90-21e34a001a30 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:06.807580 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58faf9a9-f430-4676-ac90-21e34a001a30 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:06.808032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58faf9a9-f430-4676-ac90-21e34a001a30 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:06.810115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-6d8792a8-a360-4924-8d21-b9e23a13f816 req-06156a16-9fce-46f7-9126-8e20ccc1334a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036163 May 28 14:29:06.810904 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 463/928] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:29:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:29:07.018384 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-58faf9a9-f430-4676-ac90-21e34a001a30 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:07.028036 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-58faf9a9-f430-4676-ac90-21e34a001a30 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.234572 May 28 14:29:07.028696 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 466/929] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:06 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:29:07.730927 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-af85bd88-7c86-4c2a-a9e4-61292f30eb39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8e21faf-7bd4-415d-aa22-4b8a7538c6bf"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:07.732090 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-af85bd88-7c86-4c2a-a9e4-61292f30eb39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:07.739488 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af85bd88-7c86-4c2a-a9e4-61292f30eb39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:07.741741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af85bd88-7c86-4c2a-a9e4-61292f30eb39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:07.741741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af85bd88-7c86-4c2a-a9e4-61292f30eb39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:07.741741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af85bd88-7c86-4c2a-a9e4-61292f30eb39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:08.045130 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:08.045755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:08.053093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:08.057158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:08.057985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:08.058497 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:08.265396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:08.273668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1318 microversion: 2.1 time: 0.232774 May 28 14:29:08.274234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 467/930] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:08 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:29:08.751301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-af85bd88-7c86-4c2a-a9e4-61292f30eb39 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024971 May 28 14:29:08.752051 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 464/931] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:29:07 2021] POST /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1/os-volume_attachments => generated 194 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:29:09.290693 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-57689df0-1365-4b6b-bd1a-3a92b4071803 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:09.291879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-57689df0-1365-4b6b-bd1a-3a92b4071803 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:09.299181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-57689df0-1365-4b6b-bd1a-3a92b4071803 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:09.299681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-57689df0-1365-4b6b-bd1a-3a92b4071803 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:09.300536 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-57689df0-1365-4b6b-bd1a-3a92b4071803 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:09.301250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-57689df0-1365-4b6b-bd1a-3a92b4071803 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:09.520121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-57689df0-1365-4b6b-bd1a-3a92b4071803 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:09.529171 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-57689df0-1365-4b6b-bd1a-3a92b4071803 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1505 microversion: 2.1 time: 0.242138 May 28 14:29:09.529743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 468/932] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:09 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:09.548043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7f3222ab-8424-4204-8241-09ba9c973c3d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e4ae546-c075-494b-ac15-a6c792dc0838", "device": "/dev/sdb"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:09.549266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7f3222ab-8424-4204-8241-09ba9c973c3d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:09.557767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f3222ab-8424-4204-8241-09ba9c973c3d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:09.558242 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f3222ab-8424-4204-8241-09ba9c973c3d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:09.559046 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f3222ab-8424-4204-8241-09ba9c973c3d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:09.559496 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f3222ab-8424-4204-8241-09ba9c973c3d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:10.490624 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7f3222ab-8424-4204-8241-09ba9c973c3d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "POST /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.948458 May 28 14:29:10.491314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 465/933] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:29:09 2021] POST /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6/os-volume_attachments => generated 194 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:29:17.625270 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8e21faf-7bd4-415d-aa22-4b8a7538c6bf"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:17.626363 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:17.634603 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:17.642506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:17.642506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:17.642506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:17.792415 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] HTTP exception thrown: Invalid volume: volume c8e21faf-7bd4-415d-aa22-4b8a7538c6bf is already attached to instances: d99f06a3-aa59-4312-820e-f3852cd77ac1 May 28 14:29:17.793023 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Returning 400 to user: Invalid volume: volume c8e21faf-7bd4-415d-aa22-4b8a7538c6bf is already attached to instances: d99f06a3-aa59-4312-820e-f3852cd77ac1 {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:29:17.797236 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2b403b73-8753-47f9-a182-e76ec73334ac tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.173493 May 28 14:29:17.797236 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 469/934] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:29:17 2021] POST /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1/os-volume_attachments => generated 174 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 14:29:17.898422 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-97a0a1c0-dbf9-42cf-9e2f-6a303897030c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:17.899015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-97a0a1c0-dbf9-42cf-9e2f-6a303897030c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:17.907898 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-97a0a1c0-dbf9-42cf-9e2f-6a303897030c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:17.908360 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-97a0a1c0-dbf9-42cf-9e2f-6a303897030c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:17.909144 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-97a0a1c0-dbf9-42cf-9e2f-6a303897030c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:17.909585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-97a0a1c0-dbf9-42cf-9e2f-6a303897030c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:18.067025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-97a0a1c0-dbf9-42cf-9e2f-6a303897030c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lazy-loading 'services' on Instance uuid d99f06a3-aa59-4312-820e-f3852cd77ac1 {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:29:18.349193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-97a0a1c0-dbf9-42cf-9e2f-6a303897030c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1/os-volume_attachments/c8e21faf-7bd4-415d-aa22-4b8a7538c6bf" status: 202 len: 0 microversion: 2.1 time: 0.455366 May 28 14:29:18.349830 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 466/935] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:29:17 2021] DELETE /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1/os-volume_attachments/c8e21faf-7bd4-415d-aa22-4b8a7538c6bf => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:29:34.991885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1925874406", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "networks": [{"uuid": "37e18bf5-545d-49a2-afdf-585587a7907f"}]}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:35.058325 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] validate_networks() for [('37e18bf5-545d-49a2-afdf-585587a7907f', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:29:35.715471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:29:35.715943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:29:35.716435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:29:35.716859 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:29:35.717285 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:29:35.725733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:35.726194 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:35.727022 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:35.727471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:35.745418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Getting quotas for project 94dc9f7ad5dd40429991c68c00e7ec6d. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:29:35.750304 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Getting quotas for user d9be4db3bc1f4c2386bacaee2c9232ea and project 94dc9f7ad5dd40429991c68c00e7ec6d. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:29:35.761213 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:29:35.763586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:29:35.908579 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1059deab-8594-4ad1-8cad-bc2ea4f8807a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920556 May 28 14:29:35.914379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 470/936] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:29:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:29:35.920529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4e0cf9b5-2043-47d5-a541-e1e8fd317de4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:35.921443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4e0cf9b5-2043-47d5-a541-e1e8fd317de4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:36.003201 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4e0cf9b5-2043-47d5-a541-e1e8fd317de4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:36.011180 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4e0cf9b5-2043-47d5-a541-e1e8fd317de4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1218 microversion: 2.1 time: 0.095334 May 28 14:29:36.012150 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 467/937] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:35 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:37.028502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fa871396-e387-4789-98d2-3c1782c89629 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:37.029101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fa871396-e387-4789-98d2-3c1782c89629 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:37.036532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa871396-e387-4789-98d2-3c1782c89629 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:37.036995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa871396-e387-4789-98d2-3c1782c89629 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:37.037791 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa871396-e387-4789-98d2-3c1782c89629 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:37.038244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fa871396-e387-4789-98d2-3c1782c89629 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:37.150851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fa871396-e387-4789-98d2-3c1782c89629 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:37.159268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fa871396-e387-4789-98d2-3c1782c89629 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1222 microversion: 2.1 time: 0.134588 May 28 14:29:37.159876 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 471/938] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:37 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:38.175559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-172d149c-a8a8-445f-a594-04c6a2df9cfe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:38.176247 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-172d149c-a8a8-445f-a594-04c6a2df9cfe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:38.184671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-172d149c-a8a8-445f-a594-04c6a2df9cfe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:38.185151 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-172d149c-a8a8-445f-a594-04c6a2df9cfe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:38.185909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-172d149c-a8a8-445f-a594-04c6a2df9cfe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:38.186353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-172d149c-a8a8-445f-a594-04c6a2df9cfe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:38.300155 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-172d149c-a8a8-445f-a594-04c6a2df9cfe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:38.308682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-172d149c-a8a8-445f-a594-04c6a2df9cfe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1222 microversion: 2.1 time: 0.136820 May 28 14:29:38.309263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 468/939] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:38 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:38.905014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:29:38.905359 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:29:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:29:39.325869 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5982a315-741e-4d96-9d72-5802af3f9ac6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:39.326464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5982a315-741e-4d96-9d72-5802af3f9ac6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:39.334552 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5982a315-741e-4d96-9d72-5802af3f9ac6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:39.335014 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5982a315-741e-4d96-9d72-5802af3f9ac6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:39.335824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5982a315-741e-4d96-9d72-5802af3f9ac6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:39.336265 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5982a315-741e-4d96-9d72-5802af3f9ac6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:39.451884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5982a315-741e-4d96-9d72-5802af3f9ac6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:39.460919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5982a315-741e-4d96-9d72-5802af3f9ac6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1222 microversion: 2.1 time: 0.138796 May 28 14:29:39.461457 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 472/940] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:39 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:40.477645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3d32073b-7764-4144-b95a-1a3806a438e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:40.478254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3d32073b-7764-4144-b95a-1a3806a438e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:40.486050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3d32073b-7764-4144-b95a-1a3806a438e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:40.486501 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3d32073b-7764-4144-b95a-1a3806a438e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:40.487281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3d32073b-7764-4144-b95a-1a3806a438e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:40.487761 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3d32073b-7764-4144-b95a-1a3806a438e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:40.602262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3d32073b-7764-4144-b95a-1a3806a438e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:40.610530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3d32073b-7764-4144-b95a-1a3806a438e1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1222 microversion: 2.1 time: 0.136585 May 28 14:29:40.611227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 469/941] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:40 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:41.627981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7f3796c9-4ed0-4959-83e2-e8a36481edcd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:41.628603 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7f3796c9-4ed0-4959-83e2-e8a36481edcd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:41.635841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f3796c9-4ed0-4959-83e2-e8a36481edcd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:41.636303 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f3796c9-4ed0-4959-83e2-e8a36481edcd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:41.637089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f3796c9-4ed0-4959-83e2-e8a36481edcd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:41.637536 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f3796c9-4ed0-4959-83e2-e8a36481edcd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:41.748293 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7f3796c9-4ed0-4959-83e2-e8a36481edcd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:41.757897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7f3796c9-4ed0-4959-83e2-e8a36481edcd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1214 microversion: 2.1 time: 0.134180 May 28 14:29:41.758455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 473/942] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:41 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:42.776862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f2c071c0-6eda-434f-b49a-498e38335535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:42.777516 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f2c071c0-6eda-434f-b49a-498e38335535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:42.785040 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f2c071c0-6eda-434f-b49a-498e38335535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:42.785505 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f2c071c0-6eda-434f-b49a-498e38335535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:42.786284 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f2c071c0-6eda-434f-b49a-498e38335535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:42.786733 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f2c071c0-6eda-434f-b49a-498e38335535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:42.904120 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f2c071c0-6eda-434f-b49a-498e38335535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:42.912858 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f2c071c0-6eda-434f-b49a-498e38335535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1270 microversion: 2.1 time: 0.139775 May 28 14:29:42.913425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 470/943] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:42 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:43.929162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:43.929786 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:43.937731 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:43.938986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:43.938986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:43.939377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:44.249232 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:44.258409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.333029 May 28 14:29:44.258992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 474/944] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:43 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:45.275765 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2ab709e5-5b31-474c-b87d-22ce23f5b837 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:45.276389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2ab709e5-5b31-474c-b87d-22ce23f5b837 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:45.283835 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ab709e5-5b31-474c-b87d-22ce23f5b837 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:45.284301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ab709e5-5b31-474c-b87d-22ce23f5b837 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:45.285087 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ab709e5-5b31-474c-b87d-22ce23f5b837 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:45.285527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ab709e5-5b31-474c-b87d-22ce23f5b837 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:45.404180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-f248dbd9-76b1-461c-8e63-dd0f34ba1ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a7b74cb-2311-48b6-b58b-13c358c2c0bb", "tag": "cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:45.406007 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:29:45.406007 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:29:45.422245 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-f248dbd9-76b1-461c-8e63-dd0f34ba1ca2 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:45.422245 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-f248dbd9-76b1-461c-8e63-dd0f34ba1ca2 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:45.439709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-f248dbd9-76b1-461c-8e63-dd0f34ba1ca2 service nova] Creating event network-changed:cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af for instance 9a7b74cb-2311-48b6-b58b-13c358c2c0bb on hv-cinder-79128 May 28 14:29:45.444233 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-f248dbd9-76b1-461c-8e63-dd0f34ba1ca2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044907 May 28 14:29:45.449941 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 475/945] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:29:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:29:45.492709 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2ab709e5-5b31-474c-b87d-22ce23f5b837 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:45.502258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2ab709e5-5b31-474c-b87d-22ce23f5b837 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.230617 May 28 14:29:45.502860 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 471/946] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:45 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:46.357550 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7b655bee-9827-453d-b573-bdc34ece9005 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:46.360154 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7b655bee-9827-453d-b573-bdc34ece9005 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:46.366605 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7b655bee-9827-453d-b573-bdc34ece9005 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:46.367281 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7b655bee-9827-453d-b573-bdc34ece9005 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:46.368308 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7b655bee-9827-453d-b573-bdc34ece9005 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:46.368760 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7b655bee-9827-453d-b573-bdc34ece9005 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:46.518989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9073622c-eba7-4bdd-ae45-6e95ab77aadd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:46.519721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9073622c-eba7-4bdd-ae45-6e95ab77aadd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:46.527096 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9073622c-eba7-4bdd-ae45-6e95ab77aadd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:46.527828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9073622c-eba7-4bdd-ae45-6e95ab77aadd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:46.528625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9073622c-eba7-4bdd-ae45-6e95ab77aadd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:46.529077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9073622c-eba7-4bdd-ae45-6e95ab77aadd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:46.541818 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-7b655bee-9827-453d-b573-bdc34ece9005 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lazy-loading 'services' on Instance uuid aa156ac4-b444-4c02-a917-602aa688fba6 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:29:46.732669 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9073622c-eba7-4bdd-ae45-6e95ab77aadd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:46.741014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9073622c-eba7-4bdd-ae45-6e95ab77aadd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.226156 May 28 14:29:46.741591 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 472/947] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:46 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:29:46.882657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7b655bee-9827-453d-b573-bdc34ece9005 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6/os-volume_attachments/1e4ae546-c075-494b-ac15-a6c792dc0838" status: 202 len: 0 microversion: 2.1 time: 0.529165 May 28 14:29:46.883335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 476/948] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:29:46 2021] DELETE /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6/os-volume_attachments/1e4ae546-c075-494b-ac15-a6c792dc0838 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:29:47.758599 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7e5b8e1f-ea70-4320-8669-964d0778be23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:47.759229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7e5b8e1f-ea70-4320-8669-964d0778be23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:47.766797 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e5b8e1f-ea70-4320-8669-964d0778be23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:47.767260 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e5b8e1f-ea70-4320-8669-964d0778be23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:47.768156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e5b8e1f-ea70-4320-8669-964d0778be23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:47.768606 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e5b8e1f-ea70-4320-8669-964d0778be23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:47.960508 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7e5b8e1f-ea70-4320-8669-964d0778be23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:47.969338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7e5b8e1f-ea70-4320-8669-964d0778be23 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.214020 May 28 14:29:47.969907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 473/949] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:47 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:48.986566 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7527d55b-1d97-4bc4-b261-17b5ce24e33a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:48.987279 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7527d55b-1d97-4bc4-b261-17b5ce24e33a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:48.995128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7527d55b-1d97-4bc4-b261-17b5ce24e33a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:48.995641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7527d55b-1d97-4bc4-b261-17b5ce24e33a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:48.996677 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7527d55b-1d97-4bc4-b261-17b5ce24e33a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:48.997129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7527d55b-1d97-4bc4-b261-17b5ce24e33a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:49.169333 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3228555f-1e38-48ab-bffa-adbff816f9af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:49.169849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3228555f-1e38-48ab-bffa-adbff816f9af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:49.177078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3228555f-1e38-48ab-bffa-adbff816f9af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:49.177536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3228555f-1e38-48ab-bffa-adbff816f9af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:49.178345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3228555f-1e38-48ab-bffa-adbff816f9af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:49.178822 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3228555f-1e38-48ab-bffa-adbff816f9af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:49.240234 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3228555f-1e38-48ab-bffa-adbff816f9af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:29:49.258949 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7527d55b-1d97-4bc4-b261-17b5ce24e33a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:49.267372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7527d55b-1d97-4bc4-b261-17b5ce24e33a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.284968 May 28 14:29:49.267977 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 477/950] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:48 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:49.552700 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3228555f-1e38-48ab-bffa-adbff816f9af tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 204 len: 0 microversion: 2.1 time: 0.386625 May 28 14:29:49.553240 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 474/951] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:29:49 2021] DELETE /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 14:29:49.561212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-af971194-5cc2-48b3-97d7-ae485ba15311 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:49.561838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-af971194-5cc2-48b3-97d7-ae485ba15311 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:49.569338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-af971194-5cc2-48b3-97d7-ae485ba15311 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:49.571533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-af971194-5cc2-48b3-97d7-ae485ba15311 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:49.571533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-af971194-5cc2-48b3-97d7-ae485ba15311 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:49.571533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-af971194-5cc2-48b3-97d7-ae485ba15311 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:49.765666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-af971194-5cc2-48b3-97d7-ae485ba15311 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:49.774430 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-af971194-5cc2-48b3-97d7-ae485ba15311 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1511 microversion: 2.1 time: 0.216928 May 28 14:29:49.774993 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 478/952] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:49 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:50.285549 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-63ad1846-89c6-4c61-a17c-da9502b28c66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:50.286259 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-63ad1846-89c6-4c61-a17c-da9502b28c66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:50.293499 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-63ad1846-89c6-4c61-a17c-da9502b28c66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:50.293992 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-63ad1846-89c6-4c61-a17c-da9502b28c66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:50.294783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-63ad1846-89c6-4c61-a17c-da9502b28c66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:50.295223 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-63ad1846-89c6-4c61-a17c-da9502b28c66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:50.491734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-63ad1846-89c6-4c61-a17c-da9502b28c66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:50.500731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-63ad1846-89c6-4c61-a17c-da9502b28c66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.220096 May 28 14:29:50.501288 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 475/953] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:50 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:50.792124 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:50.792752 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:50.800613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:50.801069 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:50.801852 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:50.802297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:50.998599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:51.007359 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1511 microversion: 2.1 time: 0.219041 May 28 14:29:51.007944 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 479/954] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:50 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:51.518061 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-368f6263-7b5a-4346-92cd-9e5b1ba47673 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:51.518676 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-368f6263-7b5a-4346-92cd-9e5b1ba47673 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:51.526421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-368f6263-7b5a-4346-92cd-9e5b1ba47673 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:51.526870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-368f6263-7b5a-4346-92cd-9e5b1ba47673 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:51.527671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-368f6263-7b5a-4346-92cd-9e5b1ba47673 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:51.528105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-368f6263-7b5a-4346-92cd-9e5b1ba47673 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:51.717857 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-368f6263-7b5a-4346-92cd-9e5b1ba47673 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:51.726576 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-368f6263-7b5a-4346-92cd-9e5b1ba47673 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.212805 May 28 14:29:51.727140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 476/955] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:51 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:52.023498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5a75f2b7-012a-46e6-8672-928ad8142efd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:52.024170 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5a75f2b7-012a-46e6-8672-928ad8142efd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:52.031416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5a75f2b7-012a-46e6-8672-928ad8142efd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:52.031897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5a75f2b7-012a-46e6-8672-928ad8142efd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:52.032669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5a75f2b7-012a-46e6-8672-928ad8142efd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:52.033111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5a75f2b7-012a-46e6-8672-928ad8142efd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:52.222615 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5a75f2b7-012a-46e6-8672-928ad8142efd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:52.230952 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5a75f2b7-012a-46e6-8672-928ad8142efd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1511 microversion: 2.1 time: 0.211134 May 28 14:29:52.231515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 480/956] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:52 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:52.742431 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f534c457-7604-42bb-9271-487d531857c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:52.743092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f534c457-7604-42bb-9271-487d531857c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:52.750736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f534c457-7604-42bb-9271-487d531857c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:52.751193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f534c457-7604-42bb-9271-487d531857c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:52.752008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f534c457-7604-42bb-9271-487d531857c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:52.752453 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f534c457-7604-42bb-9271-487d531857c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:52.953712 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f534c457-7604-42bb-9271-487d531857c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:52.962083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f534c457-7604-42bb-9271-487d531857c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.223475 May 28 14:29:52.962757 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 477/957] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:52 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:53.248649 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-09de3de8-60bb-4118-ad41-dca1a0c8524b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:53.249168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-09de3de8-60bb-4118-ad41-dca1a0c8524b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:53.256462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-09de3de8-60bb-4118-ad41-dca1a0c8524b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:53.256912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-09de3de8-60bb-4118-ad41-dca1a0c8524b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:53.257696 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-09de3de8-60bb-4118-ad41-dca1a0c8524b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:53.258136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-09de3de8-60bb-4118-ad41-dca1a0c8524b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:53.557462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-09de3de8-60bb-4118-ad41-dca1a0c8524b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:53.566379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-09de3de8-60bb-4118-ad41-dca1a0c8524b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1511 microversion: 2.1 time: 0.321783 May 28 14:29:53.566981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 481/958] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:53 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:53.979385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9a00a7c5-4534-4cfb-9575-1f086d4a949d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:53.980039 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9a00a7c5-4534-4cfb-9575-1f086d4a949d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:53.987717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a00a7c5-4534-4cfb-9575-1f086d4a949d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:53.988168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a00a7c5-4534-4cfb-9575-1f086d4a949d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:53.989017 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a00a7c5-4534-4cfb-9575-1f086d4a949d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:53.989791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a00a7c5-4534-4cfb-9575-1f086d4a949d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:54.206856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9a00a7c5-4534-4cfb-9575-1f086d4a949d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:54.215650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9a00a7c5-4534-4cfb-9575-1f086d4a949d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.239879 May 28 14:29:54.216463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 478/959] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:53 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:54.277848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-1aa30cec-c240-403d-80ca-2dc7b71ffa17 req-f31db6c2-2555-485c-a1e8-25ae393c8cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa156ac4-b444-4c02-a917-602aa688fba6", "name": "network-vif-deleted", "tag": "59657597-74b5-4611-a1d9-144ab84f71dc"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:54.279577 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:29:54.279577 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:29:54.288637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-1aa30cec-c240-403d-80ca-2dc7b71ffa17 req-f31db6c2-2555-485c-a1e8-25ae393c8cf6 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:54.289089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-1aa30cec-c240-403d-80ca-2dc7b71ffa17 req-f31db6c2-2555-485c-a1e8-25ae393c8cf6 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:54.305220 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-1aa30cec-c240-403d-80ca-2dc7b71ffa17 req-f31db6c2-2555-485c-a1e8-25ae393c8cf6 service nova] Creating event network-vif-deleted:59657597-74b5-4611-a1d9-144ab84f71dc for instance aa156ac4-b444-4c02-a917-602aa688fba6 on hv-cinder-79128 May 28 14:29:54.310052 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-1aa30cec-c240-403d-80ca-2dc7b71ffa17 req-f31db6c2-2555-485c-a1e8-25ae393c8cf6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035796 May 28 14:29:54.310626 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 482/960] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:29:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:29:54.584047 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:54.584800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:54.592128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:54.592578 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:54.594089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:54.594541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:54.706025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78113dc875a548d287a236802e0d6a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db248e02dac49bf8688658eb42ee752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:54.714428 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 200 len: 1303 microversion: 2.1 time: 0.134063 May 28 14:29:54.715008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 479/961] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:54 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:55.233302 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0a550ca1-339f-4c64-8f7b-e734804871a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:55.234496 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0a550ca1-339f-4c64-8f7b-e734804871a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:55.241989 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a550ca1-339f-4c64-8f7b-e734804871a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:55.242441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a550ca1-339f-4c64-8f7b-e734804871a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:55.243260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a550ca1-339f-4c64-8f7b-e734804871a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:55.243798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a550ca1-339f-4c64-8f7b-e734804871a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:55.440722 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0a550ca1-339f-4c64-8f7b-e734804871a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:55.449103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0a550ca1-339f-4c64-8f7b-e734804871a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.219855 May 28 14:29:55.449690 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 483/962] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:55 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:55.733745 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:55.734949 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] [instance: aa156ac4-b444-4c02-a917-602aa688fba6] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:55.742387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:55.742796 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:55.743645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:55.744078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:55.795564 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] HTTP exception thrown: Instance aa156ac4-b444-4c02-a917-602aa688fba6 could not be found. May 28 14:29:55.796814 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Returning 404 to user: Instance aa156ac4-b444-4c02-a917-602aa688fba6 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:29:55.797661 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-41d20de3-d98f-40e1-ba92-04d6c94f2bdb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6" status: 404 len: 111 microversion: 2.1 time: 0.067905 May 28 14:29:55.798217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 480/963] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:55 2021] GET /compute/v2.1/servers/aa156ac4-b444-4c02-a917-602aa688fba6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:29:56.465656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-500da744-5207-49c5-920c-e2eedd7ccdfc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:56.466381 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-500da744-5207-49c5-920c-e2eedd7ccdfc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:56.473938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-500da744-5207-49c5-920c-e2eedd7ccdfc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:56.475832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-500da744-5207-49c5-920c-e2eedd7ccdfc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:56.475832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-500da744-5207-49c5-920c-e2eedd7ccdfc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:56.475832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-500da744-5207-49c5-920c-e2eedd7ccdfc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:56.669081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-500da744-5207-49c5-920c-e2eedd7ccdfc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:56.677494 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-500da744-5207-49c5-920c-e2eedd7ccdfc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.215529 May 28 14:29:56.678057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 484/964] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:56 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:57.013897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-5e789e10-ba21-4db1-b0b9-a71271e33e4f req-2de0de76-ed49-40a2-b3e6-d273adf2d805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7b74cb-2311-48b6-b58b-13c358c2c0bb", "name": "network-vif-plugged", "status": "completed", "tag": "cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:29:57.015488 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:29:57.015488 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:29:57.023773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-5e789e10-ba21-4db1-b0b9-a71271e33e4f req-2de0de76-ed49-40a2-b3e6-d273adf2d805 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:57.024222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-5e789e10-ba21-4db1-b0b9-a71271e33e4f req-2de0de76-ed49-40a2-b3e6-d273adf2d805 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:57.039661 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-5e789e10-ba21-4db1-b0b9-a71271e33e4f req-2de0de76-ed49-40a2-b3e6-d273adf2d805 service nova] Creating event network-vif-plugged:cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af for instance 9a7b74cb-2311-48b6-b58b-13c358c2c0bb on hv-cinder-79128 May 28 14:29:57.044752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-5e789e10-ba21-4db1-b0b9-a71271e33e4f req-2de0de76-ed49-40a2-b3e6-d273adf2d805 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034480 May 28 14:29:57.045338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 481/965] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:29:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:29:57.693879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e53f02e0-62b2-407d-9a14-ba95b2076f6a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:57.694502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e53f02e0-62b2-407d-9a14-ba95b2076f6a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:57.701922 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e53f02e0-62b2-407d-9a14-ba95b2076f6a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:57.702381 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e53f02e0-62b2-407d-9a14-ba95b2076f6a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:57.703189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e53f02e0-62b2-407d-9a14-ba95b2076f6a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:57.703658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e53f02e0-62b2-407d-9a14-ba95b2076f6a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:57.905507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e53f02e0-62b2-407d-9a14-ba95b2076f6a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:57.913704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e53f02e0-62b2-407d-9a14-ba95b2076f6a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.223523 May 28 14:29:57.914265 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 485/966] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:57 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:29:58.931087 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-34a24d85-5202-4b8d-acd1-38e637531a69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:29:58.931830 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-34a24d85-5202-4b8d-acd1-38e637531a69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:29:58.939393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-34a24d85-5202-4b8d-acd1-38e637531a69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:58.939922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-34a24d85-5202-4b8d-acd1-38e637531a69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:58.940717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-34a24d85-5202-4b8d-acd1-38e637531a69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:58.941161 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-34a24d85-5202-4b8d-acd1-38e637531a69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:59.145962 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-34a24d85-5202-4b8d-acd1-38e637531a69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:29:59.154215 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-34a24d85-5202-4b8d-acd1-38e637531a69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1318 microversion: 2.1 time: 0.227422 May 28 14:29:59.154776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 482/967] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:29:58 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:00.177281 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5165d1d3-faf8-4849-ad08-4a159095c781 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:00.177826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5165d1d3-faf8-4849-ad08-4a159095c781 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:00.185117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5165d1d3-faf8-4849-ad08-4a159095c781 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:00.185739 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5165d1d3-faf8-4849-ad08-4a159095c781 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:00.186520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5165d1d3-faf8-4849-ad08-4a159095c781 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:00.186960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5165d1d3-faf8-4849-ad08-4a159095c781 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:00.378189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5165d1d3-faf8-4849-ad08-4a159095c781 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:00.386400 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5165d1d3-faf8-4849-ad08-4a159095c781 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1507 microversion: 2.1 time: 0.213108 May 28 14:30:00.386969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 486/968] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:00 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:02.269862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b5984f92-804b-49f5-995a-1c9d8151ea85 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:02.270837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b5984f92-804b-49f5-995a-1c9d8151ea85 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:02.278117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5984f92-804b-49f5-995a-1c9d8151ea85 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:02.278565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5984f92-804b-49f5-995a-1c9d8151ea85 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:02.279331 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5984f92-804b-49f5-995a-1c9d8151ea85 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:02.279799 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b5984f92-804b-49f5-995a-1c9d8151ea85 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:02.548378 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b5984f92-804b-49f5-995a-1c9d8151ea85 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/action" status: 202 len: 0 microversion: 2.1 time: 0.282019 May 28 14:30:02.548955 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 483/969] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:30:02 2021] POST /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:30:02.556815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7e733391-d009-4f0f-95b6-70e621aab018 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:02.557525 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7e733391-d009-4f0f-95b6-70e621aab018 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:02.561050 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fe8ca3e-90e0-4fe8-82f1-09a499ae25c7] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:30:02.566549 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e733391-d009-4f0f-95b6-70e621aab018 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:02.567017 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e733391-d009-4f0f-95b6-70e621aab018 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:02.567836 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e733391-d009-4f0f-95b6-70e621aab018 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:02.568282 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e733391-d009-4f0f-95b6-70e621aab018 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:02.766944 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7e733391-d009-4f0f-95b6-70e621aab018 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:02.775612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7e733391-d009-4f0f-95b6-70e621aab018 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1753 microversion: 2.1 time: 0.222458 May 28 14:30:02.776181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 487/970] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:02 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:03.792485 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2b2d7275-938b-4fee-a4f6-9da001120ef3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:03.793186 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2b2d7275-938b-4fee-a4f6-9da001120ef3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:03.801369 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2b2d7275-938b-4fee-a4f6-9da001120ef3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:03.801824 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2b2d7275-938b-4fee-a4f6-9da001120ef3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:03.802600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2b2d7275-938b-4fee-a4f6-9da001120ef3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:03.803072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2b2d7275-938b-4fee-a4f6-9da001120ef3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:04.001648 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2b2d7275-938b-4fee-a4f6-9da001120ef3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:04.011017 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2b2d7275-938b-4fee-a4f6-9da001120ef3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1753 microversion: 2.1 time: 0.222540 May 28 14:30:04.011528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 484/971] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:03 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:05.027518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:05.028174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:05.047645 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:05.048146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:05.048939 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:05.049383 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:05.085434 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fe8ca3e-90e0-4fe8-82f1-09a499ae25c7] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 53242. May 28 14:30:05.251659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:05.261141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.237609 May 28 14:30:05.261711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 488/972] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:05 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:05.405980 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4425784d-943c-42d4-80cf-30d47e8e40e0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "989c6ad7-01be-4c42-b30d-bf453af4a84b"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:05.407332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4425784d-943c-42d4-80cf-30d47e8e40e0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:05.418464 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4425784d-943c-42d4-80cf-30d47e8e40e0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:05.418464 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4425784d-943c-42d4-80cf-30d47e8e40e0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:05.418464 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4425784d-943c-42d4-80cf-30d47e8e40e0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:05.418464 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4425784d-943c-42d4-80cf-30d47e8e40e0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:06.277904 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:06.278541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:06.285723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:06.286172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:06.286944 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:06.287379 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:06.373529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4425784d-943c-42d4-80cf-30d47e8e40e0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "POST /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.971157 May 28 14:30:06.374192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 485/973] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:30:05 2021] POST /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:30:06.496602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:06.511745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.237484 May 28 14:30:06.523640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 489/974] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:06 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:30:07.530489 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:07.531200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:07.540090 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:07.540549 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:07.541337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:07.541777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:07.745774 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:07.756593 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.230847 May 28 14:30:07.757313 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 486/975] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:07 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:08.773387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-033c1a65-a99e-4023-982a-9cabdea90c2e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:08.774026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-033c1a65-a99e-4023-982a-9cabdea90c2e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:08.781208 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-033c1a65-a99e-4023-982a-9cabdea90c2e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:08.781604 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-033c1a65-a99e-4023-982a-9cabdea90c2e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:08.782412 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-033c1a65-a99e-4023-982a-9cabdea90c2e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:08.782858 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-033c1a65-a99e-4023-982a-9cabdea90c2e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:09.062377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-033c1a65-a99e-4023-982a-9cabdea90c2e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:09.072016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-033c1a65-a99e-4023-982a-9cabdea90c2e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.302363 May 28 14:30:09.072606 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 490/976] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:08 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:10.089697 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a32657a8-db91-430a-93f9-95ee60ba49b1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:10.090315 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a32657a8-db91-430a-93f9-95ee60ba49b1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:10.098085 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a32657a8-db91-430a-93f9-95ee60ba49b1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:10.098542 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a32657a8-db91-430a-93f9-95ee60ba49b1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:10.099326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a32657a8-db91-430a-93f9-95ee60ba49b1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:10.099798 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a32657a8-db91-430a-93f9-95ee60ba49b1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:10.296838 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a32657a8-db91-430a-93f9-95ee60ba49b1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:10.306346 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a32657a8-db91-430a-93f9-95ee60ba49b1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.220387 May 28 14:30:10.306919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 487/977] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:10 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:11.323547 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:11.324219 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:11.331409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:11.331891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:11.332661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:11.333101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:11.532994 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:11.541668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.221723 May 28 14:30:11.542242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 491/978] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:11 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:12.558112 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:12.558731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:12.566185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:12.566642 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:12.567467 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:12.568019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:12.850967 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:12.859970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.305600 May 28 14:30:12.860582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 488/979] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:12 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:13.876231 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-87de45ea-3be3-44c8-88a8-736ab1f96222 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:13.877405 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-87de45ea-3be3-44c8-88a8-736ab1f96222 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:13.884725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-87de45ea-3be3-44c8-88a8-736ab1f96222 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:13.885182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-87de45ea-3be3-44c8-88a8-736ab1f96222 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:13.885959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-87de45ea-3be3-44c8-88a8-736ab1f96222 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:13.886402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-87de45ea-3be3-44c8-88a8-736ab1f96222 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:14.083451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-87de45ea-3be3-44c8-88a8-736ab1f96222 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:14.092237 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-87de45ea-3be3-44c8-88a8-736ab1f96222 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.219961 May 28 14:30:14.092806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 492/980] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:13 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:15.116154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-80266ae1-29f5-4438-9012-37d15942d936 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:15.116154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-80266ae1-29f5-4438-9012-37d15942d936 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:15.117295 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-80266ae1-29f5-4438-9012-37d15942d936 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:15.117758 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-80266ae1-29f5-4438-9012-37d15942d936 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:15.118540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-80266ae1-29f5-4438-9012-37d15942d936 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:15.118984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-80266ae1-29f5-4438-9012-37d15942d936 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:15.319426 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-80266ae1-29f5-4438-9012-37d15942d936 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:15.328065 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-80266ae1-29f5-4438-9012-37d15942d936 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.223034 May 28 14:30:15.328638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 489/981] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:15 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:30:16.345392 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-738d951f-b251-40ac-80ee-10a3ed9eca40 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:16.346721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-738d951f-b251-40ac-80ee-10a3ed9eca40 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:16.354422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-738d951f-b251-40ac-80ee-10a3ed9eca40 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:16.354883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-738d951f-b251-40ac-80ee-10a3ed9eca40 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:16.355690 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-738d951f-b251-40ac-80ee-10a3ed9eca40 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:16.356136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-738d951f-b251-40ac-80ee-10a3ed9eca40 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:16.555804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-738d951f-b251-40ac-80ee-10a3ed9eca40 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:16.565055 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-738d951f-b251-40ac-80ee-10a3ed9eca40 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.222954 May 28 14:30:16.565634 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 493/982] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:16 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:17.582780 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-26108d38-45d3-4e1e-88a0-5cddbbc81003 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:17.583333 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-26108d38-45d3-4e1e-88a0-5cddbbc81003 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:17.590680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26108d38-45d3-4e1e-88a0-5cddbbc81003 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:17.591132 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26108d38-45d3-4e1e-88a0-5cddbbc81003 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:17.591939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26108d38-45d3-4e1e-88a0-5cddbbc81003 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:17.592379 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26108d38-45d3-4e1e-88a0-5cddbbc81003 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:17.787274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-26108d38-45d3-4e1e-88a0-5cddbbc81003 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:17.796056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-26108d38-45d3-4e1e-88a0-5cddbbc81003 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.217714 May 28 14:30:17.796623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 490/983] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:17 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:18.813343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9788bb58-9117-47da-8518-e56d2aea0410 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:18.814042 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9788bb58-9117-47da-8518-e56d2aea0410 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:18.821872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9788bb58-9117-47da-8518-e56d2aea0410 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:18.822327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9788bb58-9117-47da-8518-e56d2aea0410 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:18.823110 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9788bb58-9117-47da-8518-e56d2aea0410 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:18.823546 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9788bb58-9117-47da-8518-e56d2aea0410 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:19.026307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9788bb58-9117-47da-8518-e56d2aea0410 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:19.035420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9788bb58-9117-47da-8518-e56d2aea0410 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.225803 May 28 14:30:19.035996 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 494/984] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:18 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:19.800733 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4169b8e1-0728-4fff-9e9e-c5529fede2cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:19.801251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4169b8e1-0728-4fff-9e9e-c5529fede2cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:19.809014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4169b8e1-0728-4fff-9e9e-c5529fede2cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:19.809473 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4169b8e1-0728-4fff-9e9e-c5529fede2cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:19.814091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4169b8e1-0728-4fff-9e9e-c5529fede2cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:19.814091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4169b8e1-0728-4fff-9e9e-c5529fede2cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:19.978322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-4169b8e1-0728-4fff-9e9e-c5529fede2cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lazy-loading 'services' on Instance uuid 9a7b74cb-2311-48b6-b58b-13c358c2c0bb {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:30:20.052628 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e7408daf-0bc0-43b9-8971-d6b368a955c2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:20.053242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e7408daf-0bc0-43b9-8971-d6b368a955c2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:20.060676 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7408daf-0bc0-43b9-8971-d6b368a955c2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:20.061137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7408daf-0bc0-43b9-8971-d6b368a955c2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:20.062727 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7408daf-0bc0-43b9-8971-d6b368a955c2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:20.063249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7408daf-0bc0-43b9-8971-d6b368a955c2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:20.257729 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4169b8e1-0728-4fff-9e9e-c5529fede2cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb/os-volume_attachments/989c6ad7-01be-4c42-b30d-bf453af4a84b" status: 202 len: 0 microversion: 2.1 time: 0.461115 May 28 14:30:20.258334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 491/985] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:30:19 2021] DELETE /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb/os-volume_attachments/989c6ad7-01be-4c42-b30d-bf453af4a84b => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:30:20.416777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e7408daf-0bc0-43b9-8971-d6b368a955c2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:20.425592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e7408daf-0bc0-43b9-8971-d6b368a955c2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1758 microversion: 2.1 time: 0.377229 May 28 14:30:20.426121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 495/986] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:20 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1758 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:30:21.445237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5df2d67b-91b8-49e6-a83c-af6da15b960f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:21.445237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5df2d67b-91b8-49e6-a83c-af6da15b960f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:21.451616 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5df2d67b-91b8-49e6-a83c-af6da15b960f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:21.452073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5df2d67b-91b8-49e6-a83c-af6da15b960f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:21.452896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5df2d67b-91b8-49e6-a83c-af6da15b960f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:21.453430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5df2d67b-91b8-49e6-a83c-af6da15b960f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:21.659338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5df2d67b-91b8-49e6-a83c-af6da15b960f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:21.668319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5df2d67b-91b8-49e6-a83c-af6da15b960f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1761 microversion: 2.1 time: 0.229828 May 28 14:30:21.668895 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 492/987] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:21 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1761 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:23.941262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:23.942622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:23.950012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:23.950495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:23.951478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:23.951958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:24.015804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:30:24.406664 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 204 len: 0 microversion: 2.1 time: 0.469764 May 28 14:30:24.407243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 496/988] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:30:23 2021] DELETE /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:30:24.415217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-de35db9b-050a-424c-a975-2421fca400ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:24.418850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-de35db9b-050a-424c-a975-2421fca400ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:24.424290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-de35db9b-050a-424c-a975-2421fca400ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:24.424971 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-de35db9b-050a-424c-a975-2421fca400ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:24.425761 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-de35db9b-050a-424c-a975-2421fca400ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:24.426208 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-de35db9b-050a-424c-a975-2421fca400ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:24.627733 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-de35db9b-050a-424c-a975-2421fca400ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:24.636261 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-de35db9b-050a-424c-a975-2421fca400ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1513 microversion: 2.1 time: 0.224847 May 28 14:30:24.638244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 493/989] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:24 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:25.653911 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:25.654612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:25.661884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:25.662338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:25.663118 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:25.663574 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:25.856091 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:25.864718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1513 microversion: 2.1 time: 0.214933 May 28 14:30:25.869284 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 497/990] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:25 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:26.882420 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:26.883039 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:26.890434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:26.890890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:26.891827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:26.892274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:27.106829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:27.116080 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1513 microversion: 2.1 time: 0.238135 May 28 14:30:27.116663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 494/991] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:26 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:27.630045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-0b323550-8970-4641-8d78-b925c027b41e req-2cd3c28c-66b3-4c83-94df-d0e34cc70bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7b74cb-2311-48b6-b58b-13c358c2c0bb", "name": "network-vif-deleted", "tag": "cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:27.631749 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:30:27.631749 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:30:27.640174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-0b323550-8970-4641-8d78-b925c027b41e req-2cd3c28c-66b3-4c83-94df-d0e34cc70bc7 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:27.640667 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-0b323550-8970-4641-8d78-b925c027b41e req-2cd3c28c-66b3-4c83-94df-d0e34cc70bc7 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:27.657404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-0b323550-8970-4641-8d78-b925c027b41e req-2cd3c28c-66b3-4c83-94df-d0e34cc70bc7 service nova] Creating event network-vif-deleted:cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af for instance 9a7b74cb-2311-48b6-b58b-13c358c2c0bb on hv-cinder-79128 May 28 14:30:27.663812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-0b323550-8970-4641-8d78-b925c027b41e req-2cd3c28c-66b3-4c83-94df-d0e34cc70bc7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037425 May 28 14:30:27.664418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 498/992] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:30:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:30:28.135786 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:28.136407 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:28.144310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:28.144759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:28.145653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:28.146109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:28.217692 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:28.218146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:28.218600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lazy-loading 'fault' on Instance uuid 9a7b74cb-2311-48b6-b58b-13c358c2c0bb {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:30:28.275658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:28.284074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c697ba57-323a-489e-ba53-8233fc039325 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 200 len: 1308 microversion: 2.1 time: 0.154911 May 28 14:30:28.284675 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 495/993] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:28 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:29.302802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:29.303426 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 9a7b74cb-2311-48b6-b58b-13c358c2c0bb] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:29.310775 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:29.311226 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:29.312065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:29.312532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:29.360206 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] HTTP exception thrown: Instance 9a7b74cb-2311-48b6-b58b-13c358c2c0bb could not be found. May 28 14:30:29.360816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Returning 404 to user: Instance 9a7b74cb-2311-48b6-b58b-13c358c2c0bb could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:30:29.361655 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2dc92852-0bf2-45e4-81f7-572c12bd0938 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb" status: 404 len: 111 microversion: 2.1 time: 0.063926 May 28 14:30:29.362229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 499/994] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:29 2021] GET /compute/v2.1/servers/9a7b74cb-2311-48b6-b58b-13c358c2c0bb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:30:30.743328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:30.743936 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:30.751375 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:30.751863 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:30.752662 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:30.753751 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:30.814371 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:30:31.166225 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 204 len: 0 microversion: 2.1 time: 0.426282 May 28 14:30:31.166827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 496/995] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:30:30 2021] DELETE /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 14:30:31.175386 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-685fe009-a00a-473c-bc37-2e3b27ab4be2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:31.176569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-685fe009-a00a-473c-bc37-2e3b27ab4be2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:31.185613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-685fe009-a00a-473c-bc37-2e3b27ab4be2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:31.186161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-685fe009-a00a-473c-bc37-2e3b27ab4be2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:31.193025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-685fe009-a00a-473c-bc37-2e3b27ab4be2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:31.193025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-685fe009-a00a-473c-bc37-2e3b27ab4be2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:31.652857 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-685fe009-a00a-473c-bc37-2e3b27ab4be2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:31.661225 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-685fe009-a00a-473c-bc37-2e3b27ab4be2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1513 microversion: 2.1 time: 0.490195 May 28 14:30:31.661786 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 500/996] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:31 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1513 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:30:32.679326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3eba2548-7f89-4622-99e1-44d7af032b2b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:32.680060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3eba2548-7f89-4622-99e1-44d7af032b2b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:32.687347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3eba2548-7f89-4622-99e1-44d7af032b2b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:32.687839 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3eba2548-7f89-4622-99e1-44d7af032b2b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:32.688619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3eba2548-7f89-4622-99e1-44d7af032b2b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:32.689069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3eba2548-7f89-4622-99e1-44d7af032b2b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:32.891989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3eba2548-7f89-4622-99e1-44d7af032b2b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:32.902585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3eba2548-7f89-4622-99e1-44d7af032b2b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1513 microversion: 2.1 time: 0.227561 May 28 14:30:32.902884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 497/997] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:32 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:33.919311 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b6eb8641-0d88-4301-a8b6-143825b7827f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:33.919966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b6eb8641-0d88-4301-a8b6-143825b7827f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:33.928022 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6eb8641-0d88-4301-a8b6-143825b7827f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:33.928651 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6eb8641-0d88-4301-a8b6-143825b7827f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:33.929452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6eb8641-0d88-4301-a8b6-143825b7827f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:33.930091 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6eb8641-0d88-4301-a8b6-143825b7827f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:34.294832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b6eb8641-0d88-4301-a8b6-143825b7827f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:34.304511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b6eb8641-0d88-4301-a8b6-143825b7827f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1513 microversion: 2.1 time: 0.388882 May 28 14:30:34.305084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 501/998] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:33 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:34.649050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-50eb7fd6-9df3-4ab8-8230-0eb01b521918 req-f365a889-031a-432b-aefd-db661bdb11a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99f06a3-aa59-4312-820e-f3852cd77ac1", "name": "network-vif-deleted", "tag": "827d9299-b0be-4acd-a8ae-13dd5fbf53f3"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:34.652232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:30:34.652232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:30:34.662077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-50eb7fd6-9df3-4ab8-8230-0eb01b521918 req-f365a889-031a-432b-aefd-db661bdb11a3 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:34.662815 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-50eb7fd6-9df3-4ab8-8230-0eb01b521918 req-f365a889-031a-432b-aefd-db661bdb11a3 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:34.686618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-50eb7fd6-9df3-4ab8-8230-0eb01b521918 req-f365a889-031a-432b-aefd-db661bdb11a3 service nova] Creating event network-vif-deleted:827d9299-b0be-4acd-a8ae-13dd5fbf53f3 for instance d99f06a3-aa59-4312-820e-f3852cd77ac1 on hv-cinder-79128 May 28 14:30:34.691574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-50eb7fd6-9df3-4ab8-8230-0eb01b521918 req-f365a889-031a-432b-aefd-db661bdb11a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046710 May 28 14:30:34.692626 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 498/999] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:30:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:30:35.321202 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:35.321824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:35.329138 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:35.329654 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:35.330434 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:35.331535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:35.400085 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:35.400544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:35.401004 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lazy-loading 'fault' on Instance uuid d99f06a3-aa59-4312-820e-f3852cd77ac1 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:30:35.648184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:35.656712 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-808aa560-35a7-4075-ab3a-0c26770710ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 200 len: 1307 microversion: 2.1 time: 0.339423 May 28 14:30:35.657354 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 502/1000] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:35 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:30:36.676661 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:36.680996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: d99f06a3-aa59-4312-820e-f3852cd77ac1] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:36.687102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:36.687606 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:36.688409 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:36.689074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:36.742518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] HTTP exception thrown: Instance d99f06a3-aa59-4312-820e-f3852cd77ac1 could not be found. May 28 14:30:36.742518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Returning 404 to user: Instance d99f06a3-aa59-4312-820e-f3852cd77ac1 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:30:36.742890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-42d808d2-c1ab-4ae5-adcf-ec6ee6dbe7f5 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1" status: 404 len: 111 microversion: 2.1 time: 0.072192 May 28 14:30:36.743437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 499/1001] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:36 2021] GET /compute/v2.1/servers/d99f06a3-aa59-4312-820e-f3852cd77ac1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:30:36.751938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9ea4f229-e8ed-417b-8c35-437560b54d0e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:36.753072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9ea4f229-e8ed-417b-8c35-437560b54d0e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:36.760528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9ea4f229-e8ed-417b-8c35-437560b54d0e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:36.760985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9ea4f229-e8ed-417b-8c35-437560b54d0e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:36.761769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9ea4f229-e8ed-417b-8c35-437560b54d0e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:36.762210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9ea4f229-e8ed-417b-8c35-437560b54d0e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:36.832981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9ea4f229-e8ed-417b-8c35-437560b54d0e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:30:37.378857 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9ea4f229-e8ed-417b-8c35-437560b54d0e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 204 len: 0 microversion: 2.1 time: 0.630264 May 28 14:30:37.380027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 503/1002] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:30:36 2021] DELETE /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:30:37.388990 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2ea00753-c01c-429c-ad05-cef262016489 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:37.389715 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2ea00753-c01c-429c-ad05-cef262016489 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:37.397563 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ea00753-c01c-429c-ad05-cef262016489 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:37.398407 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ea00753-c01c-429c-ad05-cef262016489 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:37.399636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ea00753-c01c-429c-ad05-cef262016489 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:37.400358 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ea00753-c01c-429c-ad05-cef262016489 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:37.833735 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2ea00753-c01c-429c-ad05-cef262016489 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:37.843063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2ea00753-c01c-429c-ad05-cef262016489 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1513 microversion: 2.1 time: 0.459011 May 28 14:30:37.843763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 500/1003] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:37 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1513 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:38.861229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:38.861924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:38.869925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:38.870381 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:38.871181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:38.871642 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:39.103044 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:39.121886 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1513 microversion: 2.1 time: 0.264743 May 28 14:30:39.123082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 504/1004] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:38 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:30:40.140648 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:40.141520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:40.157132 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:40.157866 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:40.158898 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:40.159346 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:40.628540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-0e9c2de0-2bbf-449d-9d71-3a844c2a75e0 req-ed29d354-0b60-4ed7-a516-75fb967eadc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecfff25-834b-4f86-b9dc-0e95c9fba46d", "name": "network-vif-deleted", "tag": "c5a95e0a-897e-42cc-bae7-653a3a321292"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:40.642879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:30:40.642879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:30:40.656451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-0e9c2de0-2bbf-449d-9d71-3a844c2a75e0 req-ed29d354-0b60-4ed7-a516-75fb967eadc2 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:40.656962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-0e9c2de0-2bbf-449d-9d71-3a844c2a75e0 req-ed29d354-0b60-4ed7-a516-75fb967eadc2 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:40.680026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-0e9c2de0-2bbf-449d-9d71-3a844c2a75e0 req-ed29d354-0b60-4ed7-a516-75fb967eadc2 service nova] Creating event network-vif-deleted:c5a95e0a-897e-42cc-bae7-653a3a321292 for instance fecfff25-834b-4f86-b9dc-0e95c9fba46d on hv-cinder-79128 May 28 14:30:40.686252 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-0e9c2de0-2bbf-449d-9d71-3a844c2a75e0 req-ed29d354-0b60-4ed7-a516-75fb967eadc2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062545 May 28 14:30:40.687170 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 505/1005] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:30:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:30:40.745323 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:40.757978 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1513 microversion: 2.1 time: 0.621294 May 28 14:30:40.762516 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 501/1006] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:40 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1513 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:41.775669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:41.776340 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:41.795207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:41.801811 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:41.802663 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:41.803115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:41.918591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:41.918969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:41.919437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lazy-loading 'fault' on Instance uuid fecfff25-834b-4f86-b9dc-0e95c9fba46d {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:30:42.090489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:42.098910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 200 len: 1308 microversion: 2.1 time: 0.327539 May 28 14:30:42.113033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 506/1007] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:41 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:43.121249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:43.121882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: fecfff25-834b-4f86-b9dc-0e95c9fba46d] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:43.130947 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:43.131667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:43.132627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:43.133269 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:43.196080 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] HTTP exception thrown: Instance fecfff25-834b-4f86-b9dc-0e95c9fba46d could not be found. May 28 14:30:43.202832 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Returning 404 to user: Instance fecfff25-834b-4f86-b9dc-0e95c9fba46d could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:30:43.202832 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c86e4f07-16bd-4cec-a74c-6a635de98f43 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d" status: 404 len: 111 microversion: 2.1 time: 0.083303 May 28 14:30:43.202832 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 502/1008] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:43 2021] GET /compute/v2.1/servers/fecfff25-834b-4f86-b9dc-0e95c9fba46d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:30:44.755272 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5e060d7b-b66e-41c5-84ce-044a037ba881 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:44.755856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5e060d7b-b66e-41c5-84ce-044a037ba881 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:44.768274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5e060d7b-b66e-41c5-84ce-044a037ba881 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:44.769290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5e060d7b-b66e-41c5-84ce-044a037ba881 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:44.771283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5e060d7b-b66e-41c5-84ce-044a037ba881 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:44.772735 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5e060d7b-b66e-41c5-84ce-044a037ba881 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:44.853791 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5e060d7b-b66e-41c5-84ce-044a037ba881 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:30:45.381837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5e060d7b-b66e-41c5-84ce-044a037ba881 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 204 len: 0 microversion: 2.1 time: 0.630031 May 28 14:30:45.389609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 507/1009] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:30:44 2021] DELETE /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:30:45.398354 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9a1cc03e-2eae-4263-a57e-94999a861535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:45.399974 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9a1cc03e-2eae-4263-a57e-94999a861535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:45.421347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a1cc03e-2eae-4263-a57e-94999a861535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:45.421751 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a1cc03e-2eae-4263-a57e-94999a861535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:45.422600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a1cc03e-2eae-4263-a57e-94999a861535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:45.423051 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a1cc03e-2eae-4263-a57e-94999a861535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:45.855017 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9a1cc03e-2eae-4263-a57e-94999a861535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:45.870585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9a1cc03e-2eae-4263-a57e-94999a861535 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1512 microversion: 2.1 time: 0.476301 May 28 14:30:45.874856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 503/1010] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:45 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1512 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:46.894774 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-628d0ddf-2a5d-4d5c-a285-5e035694e275 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:46.896617 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-628d0ddf-2a5d-4d5c-a285-5e035694e275 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:46.908014 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-628d0ddf-2a5d-4d5c-a285-5e035694e275 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:46.908859 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-628d0ddf-2a5d-4d5c-a285-5e035694e275 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:46.910630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-628d0ddf-2a5d-4d5c-a285-5e035694e275 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:46.912624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-628d0ddf-2a5d-4d5c-a285-5e035694e275 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:47.727363 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-628d0ddf-2a5d-4d5c-a285-5e035694e275 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:47.741597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-628d0ddf-2a5d-4d5c-a285-5e035694e275 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1512 microversion: 2.1 time: 0.853462 May 28 14:30:47.744783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 508/1011] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:46 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1512 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:48.127249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3ad9cc63-b1f1-4c9a-ae6d-276468573e25 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:48.128361 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3ad9cc63-b1f1-4c9a-ae6d-276468573e25 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:48.136246 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ad9cc63-b1f1-4c9a-ae6d-276468573e25 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:48.136924 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ad9cc63-b1f1-4c9a-ae6d-276468573e25 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:48.137865 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ad9cc63-b1f1-4c9a-ae6d-276468573e25 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:48.143494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ad9cc63-b1f1-4c9a-ae6d-276468573e25 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:48.234515 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3ad9cc63-b1f1-4c9a-ae6d-276468573e25 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/os-volume_attachments/34860c84-f53c-4457-941f-96868a5dc84d" status: 200 len: 194 microversion: 2.20 time: 0.111569 May 28 14:30:48.238796 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 504/1012] 10.222.0.59 () {60 vars in 1454 bytes} [Fri May 28 14:30:48 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/os-volume_attachments/34860c84-f53c-4457-941f-96868a5dc84d => generated 194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:30:48.587490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9d35f196-54df-464d-8834-e1e972f807c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:48.588962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9d35f196-54df-464d-8834-e1e972f807c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:48.597210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9d35f196-54df-464d-8834-e1e972f807c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:48.597624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9d35f196-54df-464d-8834-e1e972f807c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:48.598670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9d35f196-54df-464d-8834-e1e972f807c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:48.599334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9d35f196-54df-464d-8834-e1e972f807c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:48.761999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-70210982-73e4-466a-9351-479ca0a92b98 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:48.763009 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-70210982-73e4-466a-9351-479ca0a92b98 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:48.773399 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70210982-73e4-466a-9351-479ca0a92b98 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:48.775530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70210982-73e4-466a-9351-479ca0a92b98 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:48.776602 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70210982-73e4-466a-9351-479ca0a92b98 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:48.777272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-70210982-73e4-466a-9351-479ca0a92b98 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:48.794859 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-9d35f196-54df-464d-8834-e1e972f807c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lazy-loading 'services' on Instance uuid 2c36e73b-e6ab-4203-ada8-e971693460e2 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:30:49.127465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-70210982-73e4-466a-9351-479ca0a92b98 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:49.138877 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-70210982-73e4-466a-9351-479ca0a92b98 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1512 microversion: 2.1 time: 0.381062 May 28 14:30:49.144711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 505/1013] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:48 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:30:49.171834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9d35f196-54df-464d-8834-e1e972f807c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/os-volume_attachments/34860c84-f53c-4457-941f-96868a5dc84d" status: 202 len: 0 microversion: 2.20 time: 0.597142 May 28 14:30:49.175782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 509/1014] 10.222.0.59 () {60 vars in 1457 bytes} [Fri May 28 14:30:48 2021] DELETE /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2/os-volume_attachments/34860c84-f53c-4457-941f-96868a5dc84d => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 14:30:49.615762 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-bb255161-3398-47bf-a76d-ddda2d4a5f2c req-12f53ec9-e61e-435e-8b98-cf06d782b6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eac2abf-26a1-4d1d-84ed-ac16a83ef646", "name": "network-vif-deleted", "tag": "965a8c13-7f18-4e6d-92f2-16c7c866bcfd"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:49.618556 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:30:49.618556 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:30:49.636460 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-bb255161-3398-47bf-a76d-ddda2d4a5f2c req-12f53ec9-e61e-435e-8b98-cf06d782b6f4 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:49.637474 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-bb255161-3398-47bf-a76d-ddda2d4a5f2c req-12f53ec9-e61e-435e-8b98-cf06d782b6f4 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:49.656522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-bb255161-3398-47bf-a76d-ddda2d4a5f2c req-12f53ec9-e61e-435e-8b98-cf06d782b6f4 service nova] Creating event network-vif-deleted:965a8c13-7f18-4e6d-92f2-16c7c866bcfd for instance 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 on hv-cinder-79128 May 28 14:30:49.669987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-bb255161-3398-47bf-a76d-ddda2d4a5f2c req-12f53ec9-e61e-435e-8b98-cf06d782b6f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055626 May 28 14:30:49.673116 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 506/1015] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:30:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:30:50.161555 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:50.162901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:50.180441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:50.180441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:50.180441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:50.182253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:50.265331 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:50.266061 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:50.266561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lazy-loading 'fault' on Instance uuid 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:30:50.509681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9be4db3bc1f4c2386bacaee2c9232ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:50.519215 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 200 len: 1307 microversion: 2.1 time: 0.361875 May 28 14:30:50.529668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 510/1016] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:50 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 1307 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:51.543147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:51.550198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] [instance: 3eac2abf-26a1-4d1d-84ed-ac16a83ef646] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:51.565553 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:51.572136 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:51.573192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:51.573797 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:51.606730 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:51.607289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:51.621169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:51.623641 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:51.626057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:51.626686 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:51.648535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] HTTP exception thrown: Instance 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 could not be found. May 28 14:30:51.649488 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Returning 404 to user: Instance 3eac2abf-26a1-4d1d-84ed-ac16a83ef646 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:30:51.650607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b1a9c3dd-55f6-4013-9cda-faa65c93c6e7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646" status: 404 len: 111 microversion: 2.1 time: 0.117928 May 28 14:30:51.651903 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 507/1017] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:30:51 2021] GET /compute/v2.1/servers/3eac2abf-26a1-4d1d-84ed-ac16a83ef646 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:30:51.722352 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:30:52.141153 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 204 len: 0 microversion: 2.20 time: 0.538098 May 28 14:30:52.146021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 511/1018] 10.222.0.59 () {60 vars in 1280 bytes} [Fri May 28 14:30:51 2021] DELETE /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 28 14:30:52.151008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:52.151657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:52.162735 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:52.163594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:52.164585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:52.165206 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:52.582810 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:52.595091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:52.597209 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:52.598634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.451946 May 28 14:30:52.599781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 508/1019] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:30:52 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:30:53.619640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:53.621936 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:53.631158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:53.631888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:53.632762 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:53.633518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:53.963761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:53.975735 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:53.977926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:53.979412 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6b9a7916-52fd-42f0-9986-3a22951c952c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.364848 May 28 14:30:53.981149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 512/1020] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:30:53 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:30:54.639468 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5570360b-eec6-4064-90ea-8adb2151d046 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Action: 'create', calling method: .version_select at 0x7f2aaeec5d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-2034719293"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:54.665410 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-5570360b-eec6-4064-90ea-8adb2151d046 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Getting quotas for project 26daec94fed843c8b74a9ff7d18ecdb5. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:30:54.669428 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-5570360b-eec6-4064-90ea-8adb2151d046 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Getting quotas for user b97d344e60d043dda3c4762eb75e08a8 and project 26daec94fed843c8b74a9ff7d18ecdb5. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:30:54.929541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-5570360b-eec6-4064-90ea-8adb2151d046 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Getting quotas for project 26daec94fed843c8b74a9ff7d18ecdb5. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:30:54.933275 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-5570360b-eec6-4064-90ea-8adb2151d046 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Getting quotas for user b97d344e60d043dda3c4762eb75e08a8 and project 26daec94fed843c8b74a9ff7d18ecdb5. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:30:54.947388 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5570360b-eec6-4064-90ea-8adb2151d046 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.575988 May 28 14:30:54.948399 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 509/1021] 10.222.0.59 () {60 vars in 1158 bytes} [Fri May 28 14:30:54 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:30:55.000523 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:55.001951 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:55.010609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:55.011060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:55.012141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:55.012669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:55.410053 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:55.420448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:55.421961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:55.423111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1723 microversion: 2.20 time: 0.428695 May 28 14:30:55.431970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 513/1022] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:30:54 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:30:56.015859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-3b3e39e0-bd77-4749-9025-f62232a714b3 req-503967ce-ad05-4dab-8718-36862b92fff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c36e73b-e6ab-4203-ada8-e971693460e2", "name": "network-vif-deleted", "tag": "c2872b93-4077-4bc0-8619-140f73de2a3a"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:56.018097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:30:56.018097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:30:56.033238 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-3b3e39e0-bd77-4749-9025-f62232a714b3 req-503967ce-ad05-4dab-8718-36862b92fff8 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:56.036557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-3b3e39e0-bd77-4749-9025-f62232a714b3 req-503967ce-ad05-4dab-8718-36862b92fff8 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:56.074073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-3b3e39e0-bd77-4749-9025-f62232a714b3 req-503967ce-ad05-4dab-8718-36862b92fff8 service nova] Creating event network-vif-deleted:c2872b93-4077-4bc0-8619-140f73de2a3a for instance 2c36e73b-e6ab-4203-ada8-e971693460e2 on hv-cinder-79128 May 28 14:30:56.079184 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-3b3e39e0-bd77-4749-9025-f62232a714b3 req-503967ce-ad05-4dab-8718-36862b92fff8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067385 May 28 14:30:56.083240 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 510/1023] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:30:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:30:56.446284 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:56.446946 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:56.458903 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:56.462337 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:56.471954 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:56.472394 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:56.561520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:56.562256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:56.562681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lazy-loading 'fault' on Instance uuid 2c36e73b-e6ab-4203-ada8-e971693460e2 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:30:56.846654 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:56.859411 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:56.860986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:30:56.862892 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ae81db21-5bdf-492d-94f9-61c6ef49e19c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 200 len: 1371 microversion: 2.20 time: 0.422096 May 28 14:30:56.864178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 514/1024] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:30:56 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 1371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:30:57.884178 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:57.884903 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:30:57.893713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:57.894241 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:57.894994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:57.897713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:57.980779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] HTTP exception thrown: Instance 2c36e73b-e6ab-4203-ada8-e971693460e2 could not be found. May 28 14:30:57.981521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Returning 404 to user: Instance 2c36e73b-e6ab-4203-ada8-e971693460e2 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:30:57.982556 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-02bcf641-c472-4ec2-9775-de39ee0fd898 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 404 len: 111 microversion: 2.20 time: 0.104217 May 28 14:30:57.983882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 511/1025] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:30:57 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 14:30:57.994311 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-72496945-dfaf-4381-a8d1-382d9ce2a112 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '.version_select at 0x7f2aad969f70>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:58.214136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-72496945-dfaf-4381-a8d1-382d9ce2a112 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239197473" status: 204 len: 0 microversion: 2.20 time: 0.222601 May 28 14:30:58.215182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 515/1026] 10.222.0.59 () {60 vars in 1262 bytes} [Fri May 28 14:30:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239197473 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 14:30:59.239585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-be6c18f3-e471-46ee-ac6c-51dadf6b533f tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aae63e280>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:30:59.345585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-be6c18f3-e471-46ee-ac6c-51dadf6b533f tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6d207f77-210a-42a4-9234-b4202df5adc6" status: 200 len: 351 microversion: 2.1 time: 0.110185 May 28 14:30:59.346457 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 512/1027] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:30:59 2021] GET /compute/v2.1/os-volumes/6d207f77-210a-42a4-9234-b4202df5adc6 => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:30:59.827673 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e7dcbcf2-34e0-419b-9399-8c45ad896c9c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'create', calling method: .version_select at 0x7f2aae507550>, body: {"keypair": {"name": "tempest-keypair-1152347964"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:30:59.851306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-e7dcbcf2-34e0-419b-9399-8c45ad896c9c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'key_pairs'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:30:59.855289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-e7dcbcf2-34e0-419b-9399-8c45ad896c9c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for user 3c5d9664f5ec42ce8aa849388e53c404 and project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'key_pairs'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:31:00.159347 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-e7dcbcf2-34e0-419b-9399-8c45ad896c9c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'key_pairs'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:31:00.163169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-e7dcbcf2-34e0-419b-9399-8c45ad896c9c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for user 3c5d9664f5ec42ce8aa849388e53c404 and project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'key_pairs'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:31:00.176371 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e7dcbcf2-34e0-419b-9399-8c45ad896c9c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.352513 May 28 14:31:00.176996 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 516/1028] 10.222.0.59 () {62 vars in 1199 bytes} [Fri May 28 14:30:59 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 354 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 28 14:31:02.358086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a652c0d4-9096-4e9a-a1c3-5bbd6d444632 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aad376280>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:02.453079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a652c0d4-9096-4e9a-a1c3-5bbd6d444632 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5e48cb1d-a35a-4bd5-94a0-05026ce5eb3d" status: 200 len: 351 microversion: 2.1 time: 0.098913 May 28 14:31:02.453651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 513/1029] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:31:02 2021] GET /compute/v2.1/os-volumes/5e48cb1d-a35a-4bd5-94a0-05026ce5eb3d => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:31:03.189018 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-677889936", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "936c4847-d3d4-4250-b543-dc72dd308858"}], "security_groups": [{"name": "tempest-securitygroup--97907957"}], "key_name": "tempest-keypair-1152347964", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:03.313010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] validate_networks() for [('936c4847-d3d4-4250-b543-dc72dd308858', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:31:04.042797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:31:04.043237 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:31:04.043780 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:31:04.044239 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:31:04.044664 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:31:04.054146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:04.054603 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:04.055428 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:04.055919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:04.073907 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:31:04.078029 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Getting quotas for user 3c5d9664f5ec42ce8aa849388e53c404 and project 3bbdb80ac64d4db395d276876322e7b0. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:31:04.088915 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:31:04.091275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:31:04.242704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fd23e2b8-d35d-445d-a164-dcd1354e209c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.057868 May 28 14:31:04.243478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 517/1030] 10.222.0.59 () {62 vars in 1188 bytes} [Fri May 28 14:31:03 2021] POST /compute/v2.1/servers => generated 400 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 14:31:04.254218 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-02e61499-f8f6-48ff-948d-a45fbac12cc0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:04.254919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-02e61499-f8f6-48ff-948d-a45fbac12cc0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:04.413841 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-02e61499-f8f6-48ff-948d-a45fbac12cc0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:04.421919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-02e61499-f8f6-48ff-948d-a45fbac12cc0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:04.423477 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-02e61499-f8f6-48ff-948d-a45fbac12cc0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:04.425534 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-02e61499-f8f6-48ff-948d-a45fbac12cc0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1281 microversion: 2.20 time: 0.175505 May 28 14:31:04.426097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 514/1031] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:04 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:05.443927 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:05.444537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:05.451914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0c94cb7a-028d-4304-ba2f-d02e1e22dde2 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aad278670>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:05.454901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:05.454901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:05.454901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:05.454901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:05.547416 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0c94cb7a-028d-4304-ba2f-d02e1e22dde2 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/de44f002-57ed-44ce-93b6-540a391d02b9" status: 200 len: 351 microversion: 2.1 time: 0.099847 May 28 14:31:05.559150 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 515/1032] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:31:05 2021] GET /compute/v2.1/os-volumes/de44f002-57ed-44ce-93b6-540a391d02b9 => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:31:05.564377 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ae2cbea0-8393-46cf-930a-d8925b1fc4f2 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aad2775e0>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:05.604614 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:05.614553 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:05.616393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:05.617589 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0563d599-06d8-4305-974a-c4dfccffe2b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1285 microversion: 2.20 time: 0.177963 May 28 14:31:05.618146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 518/1033] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:05 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:05.661291 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ae2cbea0-8393-46cf-930a-d8925b1fc4f2 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.100682 May 28 14:31:05.661859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 516/1034] 10.222.0.59 () {58 vars in 1134 bytes} [Fri May 28 14:31:05 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:05.674003 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-06f7cf21-b0d4-486c-a796-d3d97aadd6dd tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aae504ca0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:05.760114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-06f7cf21-b0d4-486c-a796-d3d97aadd6dd tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089717 May 28 14:31:05.760697 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 519/1035] 10.222.0.59 () {58 vars in 1149 bytes} [Fri May 28 14:31:05 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:05.773146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-07dcbf7c-91a8-4b68-95e6-cb7e4f13dd28 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aad3a9160>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:05.862220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-07dcbf7c-91a8-4b68-95e6-cb7e4f13dd28 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.092716 May 28 14:31:05.862934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 517/1036] 10.222.0.59 () {58 vars in 1134 bytes} [Fri May 28 14:31:05 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:05.874143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d9c9cb22-aef0-4d6c-af5f-11f1de158ee5 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aad9f89d0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:05.957296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d9c9cb22-aef0-4d6c-af5f-11f1de158ee5 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087001 May 28 14:31:05.957973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 520/1037] 10.222.0.59 () {58 vars in 1167 bytes} [Fri May 28 14:31:05 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:05.969553 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-20cfffb3-de65-4eda-886a-1f9ab0b558a7 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aad4568b0>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:06.052171 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-20cfffb3-de65-4eda-886a-1f9ab0b558a7 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086251 May 28 14:31:06.052753 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 518/1038] 10.222.0.59 () {58 vars in 1170 bytes} [Fri May 28 14:31:05 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:06.065586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2ca375ef-22ff-49a8-8844-a0f0af2f04fe tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aae567ca0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:06.150221 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2ca375ef-22ff-49a8-8844-a0f0af2f04fe tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089305 May 28 14:31:06.153012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 521/1039] 10.222.0.59 () {58 vars in 1155 bytes} [Fri May 28 14:31:06 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:06.162459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cca19849-4c77-4c0e-b5cf-1ff985e57bf0 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aad277b80>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:06.244390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cca19849-4c77-4c0e-b5cf-1ff985e57bf0 tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086215 May 28 14:31:06.244990 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 519/1040] 10.222.0.59 () {58 vars in 1188 bytes} [Fri May 28 14:31:06 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:06.257064 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7c22a2ac-91bb-46f4-8d4d-565032c037fb tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] Calling method '.version_select at 0x7f2aae567a60>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:06.341569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7c22a2ac-91bb-46f4-8d4d-565032c037fb tempest-VolumesTestJSON-252640334 tempest-VolumesTestJSON-252640334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088083 May 28 14:31:06.342152 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 522/1041] 10.222.0.59 () {58 vars in 1155 bytes} [Fri May 28 14:31:06 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:06.636899 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:06.638351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:06.650823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:06.651582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:06.652622 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:06.653231 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:06.782170 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:06.791523 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:06.793107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:06.794188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1341 microversion: 2.20 time: 0.161134 May 28 14:31:06.794785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 520/1042] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:06 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:31:07.812819 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:07.814061 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:07.822833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:07.823398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:07.824545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:07.825141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:08.333583 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:08.342411 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:08.343965 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:08.345056 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-953f3f36-2761-4b22-b55a-734353921fa8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1405 microversion: 2.20 time: 0.536963 May 28 14:31:08.345617 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 523/1043] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:07 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:09.115043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-f64b5a91-fac3-415a-a1c4-be46893cb0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d654fce7-a7f9-4505-bb9a-de526002e464", "tag": "65e6ef94-43dd-499b-b9bb-2e42a8536b59"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:09.116731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:09.116731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:31:09.125227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-f64b5a91-fac3-415a-a1c4-be46893cb0e6 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:09.125677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-f64b5a91-fac3-415a-a1c4-be46893cb0e6 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:09.142885 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-f64b5a91-fac3-415a-a1c4-be46893cb0e6 service nova] Creating event network-changed:65e6ef94-43dd-499b-b9bb-2e42a8536b59 for instance d654fce7-a7f9-4505-bb9a-de526002e464 on hv-cinder-79128 May 28 14:31:09.147909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-f64b5a91-fac3-415a-a1c4-be46893cb0e6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037042 May 28 14:31:09.148766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 521/1044] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:09.364501 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:09.365503 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:09.378840 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:09.379897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:09.381483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:09.382349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:09.729060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:09.738270 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:09.739862 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:09.740986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3a30175e-a970-4919-a56b-c3bde1074c7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1405 microversion: 2.20 time: 0.381250 May 28 14:31:09.741546 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 524/1045] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:09 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:10.761172 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:10.761896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:10.770376 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:10.770864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:10.771679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:10.772125 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:11.104079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:11.114494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:11.116101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:11.117264 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9ac7763d-8109-476c-9082-7ec390cfd89c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1405 microversion: 2.20 time: 0.361258 May 28 14:31:11.117824 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 522/1046] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:10 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1405 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:11.607309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:11.607827 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:11.618284 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:11.618734 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:11.619523 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:11.620000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:11.682981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:31:12.046252 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 204 len: 0 microversion: 2.1 time: 0.634068 May 28 14:31:12.046880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 525/1047] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:31:11 2021] DELETE /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:31:12.055474 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7bc81624-e377-4105-b144-c22ffe0f15ea tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:12.056154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7bc81624-e377-4105-b144-c22ffe0f15ea tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:12.065190 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7bc81624-e377-4105-b144-c22ffe0f15ea tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.065689 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7bc81624-e377-4105-b144-c22ffe0f15ea tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.066515 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7bc81624-e377-4105-b144-c22ffe0f15ea tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.067103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7bc81624-e377-4105-b144-c22ffe0f15ea tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.137962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:12.139753 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:12.150401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.151271 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.152395 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.153070 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.282655 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7bc81624-e377-4105-b144-c22ffe0f15ea tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:12.292398 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7bc81624-e377-4105-b144-c22ffe0f15ea tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1578 microversion: 2.1 time: 0.241191 May 28 14:31:12.292983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 523/1048] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:12 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:12.465184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:12.474213 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:12.475968 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:12.477047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1405 microversion: 2.20 time: 0.344701 May 28 14:31:12.484418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 526/1049] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:12 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1405 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:31:12.911435 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:31:12.911644 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:31:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:31:13.310254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-39f8f277-273e-413c-b679-1c7edea13880 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:13.310888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-39f8f277-273e-413c-b679-1c7edea13880 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:13.318475 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39f8f277-273e-413c-b679-1c7edea13880 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:13.324761 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39f8f277-273e-413c-b679-1c7edea13880 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:13.324761 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39f8f277-273e-413c-b679-1c7edea13880 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:13.324761 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39f8f277-273e-413c-b679-1c7edea13880 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:13.496423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:13.497676 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:13.513132 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:13.513809 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:13.514771 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:13.515374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:13.523288 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-39f8f277-273e-413c-b679-1c7edea13880 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:13.532788 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-39f8f277-273e-413c-b679-1c7edea13880 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1578 microversion: 2.1 time: 0.226420 May 28 14:31:13.540285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 524/1050] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:13 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1578 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:13.744745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:13.753992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:13.755520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:13.758658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-714d5939-42b2-4c18-8889-8b4755f70307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1405 microversion: 2.20 time: 0.263995 May 28 14:31:13.758658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 527/1051] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:13 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:14.556107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f6469b95-babf-4872-b95e-0929c45d1f60 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:14.556728 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f6469b95-babf-4872-b95e-0929c45d1f60 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:14.565191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f6469b95-babf-4872-b95e-0929c45d1f60 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:14.565681 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f6469b95-babf-4872-b95e-0929c45d1f60 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:14.566480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f6469b95-babf-4872-b95e-0929c45d1f60 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:14.566916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f6469b95-babf-4872-b95e-0929c45d1f60 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:14.774406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:14.775669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:14.781766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f6469b95-babf-4872-b95e-0929c45d1f60 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:14.783713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:14.784433 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:14.785655 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:14.786318 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:14.791075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f6469b95-babf-4872-b95e-0929c45d1f60 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1578 microversion: 2.1 time: 0.238942 May 28 14:31:14.800657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 525/1052] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:14 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1578 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:15.087499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:15.096838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:15.098661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:15.099802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1405 microversion: 2.20 time: 0.329089 May 28 14:31:15.100365 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 528/1053] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:14 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1405 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:31:15.513567 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-11c7f179-e6ef-4d48-bd60-011e84c56f53 req-2282ba59-9c1d-4d2b-a792-7baab737cb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d654fce7-a7f9-4505-bb9a-de526002e464", "name": "network-vif-plugged", "status": "completed", "tag": "65e6ef94-43dd-499b-b9bb-2e42a8536b59"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:15.515353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:15.515353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:31:15.525229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-11c7f179-e6ef-4d48-bd60-011e84c56f53 req-2282ba59-9c1d-4d2b-a792-7baab737cb13 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:15.525762 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-11c7f179-e6ef-4d48-bd60-011e84c56f53 req-2282ba59-9c1d-4d2b-a792-7baab737cb13 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:15.543271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-11c7f179-e6ef-4d48-bd60-011e84c56f53 req-2282ba59-9c1d-4d2b-a792-7baab737cb13 service nova] Creating event network-vif-plugged:65e6ef94-43dd-499b-b9bb-2e42a8536b59 for instance d654fce7-a7f9-4505-bb9a-de526002e464 on hv-cinder-79128 May 28 14:31:15.548214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-11c7f179-e6ef-4d48-bd60-011e84c56f53 req-2282ba59-9c1d-4d2b-a792-7baab737cb13 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040142 May 28 14:31:15.549652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 526/1054] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:15.807898 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1b909a26-2fa2-4d16-aa16-2d745e921626 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:15.808634 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1b909a26-2fa2-4d16-aa16-2d745e921626 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:15.822342 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1b909a26-2fa2-4d16-aa16-2d745e921626 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:15.822941 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1b909a26-2fa2-4d16-aa16-2d745e921626 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:15.824554 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1b909a26-2fa2-4d16-aa16-2d745e921626 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:15.825094 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1b909a26-2fa2-4d16-aa16-2d745e921626 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:15.881320 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-467b930a-8b0d-4324-a2fb-8da00447e5ae req-3c583456-6f77-408b-b447-0aac372709bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be0a35c-b0fe-4a26-b785-3e16aa182171", "name": "network-vif-deleted", "tag": "4b79b510-d52c-4720-bf56-28c541fff0b4"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:15.882663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:15.882663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:31:15.911663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-467b930a-8b0d-4324-a2fb-8da00447e5ae req-3c583456-6f77-408b-b447-0aac372709bf service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:15.911663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-467b930a-8b0d-4324-a2fb-8da00447e5ae req-3c583456-6f77-408b-b447-0aac372709bf service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:15.928162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-467b930a-8b0d-4324-a2fb-8da00447e5ae req-3c583456-6f77-408b-b447-0aac372709bf service nova] Creating event network-vif-deleted:4b79b510-d52c-4720-bf56-28c541fff0b4 for instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 on hv-cinder-79128 May 28 14:31:15.933099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-467b930a-8b0d-4324-a2fb-8da00447e5ae req-3c583456-6f77-408b-b447-0aac372709bf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056908 May 28 14:31:15.933700 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 527/1055] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:31:16.042571 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1b909a26-2fa2-4d16-aa16-2d745e921626 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:16.067150 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1b909a26-2fa2-4d16-aa16-2d745e921626 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1510 microversion: 2.1 time: 0.263353 May 28 14:31:16.076084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 529/1056] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:15 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:16.119209 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:16.121944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:16.136606 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:16.137260 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:16.138502 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:16.139109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:16.352990 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:16.361958 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:16.363651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:16.364718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a007640a-5fb9-4fa6-833e-0a17814de872 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1405 microversion: 2.20 time: 0.249938 May 28 14:31:16.365301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 528/1057] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:16 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:17.092472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:17.093178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:17.100697 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:17.101243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:17.102046 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:17.102487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:17.176509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:17.176972 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:17.177421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lazy-loading 'fault' on Instance uuid 2be0a35c-b0fe-4a26-b785-3e16aa182171 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:31:17.239040 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:17.247828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ddecf392-0eab-411a-b83c-94ab01c40e9a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 200 len: 1230 microversion: 2.1 time: 0.159173 May 28 14:31:17.254437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 530/1058] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:17 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 1230 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:17.382828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:17.383388 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:17.390998 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:17.391542 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:17.394429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:17.394913 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:17.606166 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:17.616678 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:17.619267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:17.620933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b76a81f6-8eda-4287-a61f-404f96688a65 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1405 microversion: 2.20 time: 0.241803 May 28 14:31:17.621500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 529/1059] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:17 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:18.264958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:18.265637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:18.273801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:18.274290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:18.275082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:18.275531 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:18.326060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] HTTP exception thrown: Instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 could not be found. May 28 14:31:18.326679 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Returning 404 to user: Instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:31:18.327562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0aa43fc9-5bc9-41aa-a189-8dd8c99d0446 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 404 len: 111 microversion: 2.1 time: 0.066333 May 28 14:31:18.328603 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 531/1060] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:18 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:31:18.437613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-789548816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1591401235", "security_groups": [{"name": "tempest-secgroup-smoke-2127224596"}], "block_device_mapping_v2": [{"uuid": "8b8c8743-330a-4c8c-90ce-f3a34bc1eff0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "89b0ce92-0695-466c-b1ce-9a354ecba633"}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:18.598314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] validate_networks() for [('89b0ce92-0695-466c-b1ce-9a354ecba633', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:31:18.639244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:18.639892 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:18.647053 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:18.647519 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:18.648349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:18.648797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:18.858026 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:18.867930 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:18.869469 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:18.870612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d1847ebd-c136-4538-ab47-7202ac69ce02 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1597 microversion: 2.20 time: 0.235256 May 28 14:31:18.871168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 532/1061] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:31:18 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1597 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:31:18.892386 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:18.892817 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:18.900112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:18.900568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:18.901360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:18.901803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:19.054372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.165769 May 28 14:31:19.054978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 533/1062] 10.222.0.59 () {60 vars in 1316 bytes} [Fri May 28 14:31:18 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:31:19.301664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:31:19.301664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:31:19.301664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:31:19.301664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:31:19.301664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:31:19.314464 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:19.315079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:19.315988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:19.316560 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:19.338064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for project c6d2d25991f04f00a48394ddbeec688e. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:31:19.342480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for user 75fb81f5f54947be9db03d07ad8d6ebb and project c6d2d25991f04f00a48394ddbeec688e. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:31:19.447441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:31:19.450156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b8c8743-330a-4c8c-90ce-f3a34bc1eff0',volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:31:20.021997 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8667a337-b73f-40d2-90b9-9b160d8a75d3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.587945 May 28 14:31:20.022906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 530/1063] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:31:18 2021] POST /compute/v2.1/servers => generated 406 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 14:31:20.033744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0b3637b2-a25e-4128-896a-66c1238ba051 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:20.035312 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0b3637b2-a25e-4128-896a-66c1238ba051 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:20.240468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0b3637b2-a25e-4128-896a-66c1238ba051 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:20.247925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0b3637b2-a25e-4128-896a-66c1238ba051 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1094 microversion: 2.1 time: 0.218996 May 28 14:31:20.248764 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 534/1064] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:20 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1094 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:20.983732 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-bddc8278-b2de-43ce-967e-e38a1419152e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d654fce7-a7f9-4505-bb9a-de526002e464", "tag": "65e6ef94-43dd-499b-b9bb-2e42a8536b59"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:20.987355 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:20.987355 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:31:20.998416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-bddc8278-b2de-43ce-967e-e38a1419152e service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:21.004147 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-bddc8278-b2de-43ce-967e-e38a1419152e service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:21.023938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-bddc8278-b2de-43ce-967e-e38a1419152e service nova] Creating event network-changed:65e6ef94-43dd-499b-b9bb-2e42a8536b59 for instance d654fce7-a7f9-4505-bb9a-de526002e464 on hv-cinder-79128 May 28 14:31:21.029235 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-bddc8278-b2de-43ce-967e-e38a1419152e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050197 May 28 14:31:21.030227 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 535/1065] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:31:21.205146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f0d2b2ce-baea-44da-adbf-92c3e2bbd0c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:21.206633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f0d2b2ce-baea-44da-adbf-92c3e2bbd0c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:21.215940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0d2b2ce-baea-44da-adbf-92c3e2bbd0c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:21.216703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0d2b2ce-baea-44da-adbf-92c3e2bbd0c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:21.217838 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0d2b2ce-baea-44da-adbf-92c3e2bbd0c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:21.218654 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0d2b2ce-baea-44da-adbf-92c3e2bbd0c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:21.264793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:21.266524 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:21.274567 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:21.275176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:21.276106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:21.276777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:21.326861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f0d2b2ce-baea-44da-adbf-92c3e2bbd0c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 14 microversion: 2.20 time: 0.347555 May 28 14:31:21.331392 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 531/1066] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:20 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 14 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:21.437343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:21.462988 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1144 microversion: 2.1 time: 0.202064 May 28 14:31:21.463851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 536/1067] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:21 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1144 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:22.339598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b4a94221-22a0-43c9-9fdb-d3bef304d88f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:22.341023 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b4a94221-22a0-43c9-9fdb-d3bef304d88f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:22.354947 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b4a94221-22a0-43c9-9fdb-d3bef304d88f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:22.355419 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b4a94221-22a0-43c9-9fdb-d3bef304d88f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:22.356279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b4a94221-22a0-43c9-9fdb-d3bef304d88f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:22.357870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b4a94221-22a0-43c9-9fdb-d3bef304d88f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:22.470608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b4a94221-22a0-43c9-9fdb-d3bef304d88f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 14 microversion: 2.20 time: 0.136210 May 28 14:31:22.471332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 532/1068] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:22 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:22.481448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f87f3c4e-9538-482e-ad86-47ba75de7e6a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:22.482155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f87f3c4e-9538-482e-ad86-47ba75de7e6a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:22.490661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f87f3c4e-9538-482e-ad86-47ba75de7e6a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:22.495209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f87f3c4e-9538-482e-ad86-47ba75de7e6a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:22.495209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f87f3c4e-9538-482e-ad86-47ba75de7e6a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:22.495209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f87f3c4e-9538-482e-ad86-47ba75de7e6a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:22.651807 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f87f3c4e-9538-482e-ad86-47ba75de7e6a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:22.664878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f87f3c4e-9538-482e-ad86-47ba75de7e6a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1200 microversion: 2.1 time: 0.188049 May 28 14:31:22.665471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 537/1069] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:22 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1200 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:23.487512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-debe2564-1433-4488-a4bb-0ed3aaa0b8b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:23.490120 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-debe2564-1433-4488-a4bb-0ed3aaa0b8b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:23.498543 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-debe2564-1433-4488-a4bb-0ed3aaa0b8b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:23.499069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-debe2564-1433-4488-a4bb-0ed3aaa0b8b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:23.499856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-debe2564-1433-4488-a4bb-0ed3aaa0b8b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:23.500299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-debe2564-1433-4488-a4bb-0ed3aaa0b8b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:23.602002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-debe2564-1433-4488-a4bb-0ed3aaa0b8b7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 14 microversion: 2.20 time: 0.123556 May 28 14:31:23.602910 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 533/1070] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:23 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:23.682124 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:23.682890 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:23.690161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:23.690781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:23.691502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:23.691959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:24.346637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:24.355179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1278 microversion: 2.1 time: 0.676766 May 28 14:31:24.356022 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 538/1071] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:23 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1278 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:24.614207 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9122f77c-eab6-42d0-82e9-66dddaf0e489 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:24.615322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9122f77c-eab6-42d0-82e9-66dddaf0e489 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:24.628626 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9122f77c-eab6-42d0-82e9-66dddaf0e489 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:24.629330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9122f77c-eab6-42d0-82e9-66dddaf0e489 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:24.630485 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9122f77c-eab6-42d0-82e9-66dddaf0e489 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:24.631085 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9122f77c-eab6-42d0-82e9-66dddaf0e489 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:24.740148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9122f77c-eab6-42d0-82e9-66dddaf0e489 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 14 microversion: 2.20 time: 0.130318 May 28 14:31:24.743606 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 534/1072] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:24 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:25.118014 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-03748d16-ffc8-46ee-8687-69822648507c req-661271ea-246f-40be-b7d3-0cb0d33e9e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44daf467-480b-40ee-8e1b-567ea8d285ee", "tag": "a1d19f37-64ae-4f18-a8f2-79559df44a3b"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:25.119726 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:25.119726 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:31:25.129854 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-03748d16-ffc8-46ee-8687-69822648507c req-661271ea-246f-40be-b7d3-0cb0d33e9e99 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:25.130582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-03748d16-ffc8-46ee-8687-69822648507c req-661271ea-246f-40be-b7d3-0cb0d33e9e99 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:25.158650 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-03748d16-ffc8-46ee-8687-69822648507c req-661271ea-246f-40be-b7d3-0cb0d33e9e99 service nova] Creating event network-changed:a1d19f37-64ae-4f18-a8f2-79559df44a3b for instance 44daf467-480b-40ee-8e1b-567ea8d285ee on hv-cinder-79128 May 28 14:31:25.163413 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-03748d16-ffc8-46ee-8687-69822648507c req-661271ea-246f-40be-b7d3-0cb0d33e9e99 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049777 May 28 14:31:25.164064 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 539/1073] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:25.373332 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bdeb2595-e167-47da-b7cb-0d2802b38032 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:25.374001 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bdeb2595-e167-47da-b7cb-0d2802b38032 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:25.383219 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdeb2595-e167-47da-b7cb-0d2802b38032 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:25.383720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdeb2595-e167-47da-b7cb-0d2802b38032 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:25.384687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdeb2595-e167-47da-b7cb-0d2802b38032 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:25.385128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bdeb2595-e167-47da-b7cb-0d2802b38032 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:25.602988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bdeb2595-e167-47da-b7cb-0d2802b38032 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:25.612844 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bdeb2595-e167-47da-b7cb-0d2802b38032 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.243812 May 28 14:31:25.616065 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 535/1074] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:25 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:25.751485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c1989c2c-ae7f-40b6-9ef0-e0ea227b5f01 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:25.752521 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c1989c2c-ae7f-40b6-9ef0-e0ea227b5f01 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:25.760463 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1989c2c-ae7f-40b6-9ef0-e0ea227b5f01 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:25.760953 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1989c2c-ae7f-40b6-9ef0-e0ea227b5f01 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:25.761760 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1989c2c-ae7f-40b6-9ef0-e0ea227b5f01 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:25.762209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1989c2c-ae7f-40b6-9ef0-e0ea227b5f01 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:25.864528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c1989c2c-ae7f-40b6-9ef0-e0ea227b5f01 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 14 microversion: 2.20 time: 0.117426 May 28 14:31:25.865316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 540/1075] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:25 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:26.458362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-618719290", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2034719293", "security_groups": [{"name": "tempest-secgroup-smoke-1469735783"}], "networks": [{"uuid": "cf0db8bd-5a73-44bf-9367-58867c9e819f"}], "block_device_mapping_v2": [{"uuid": "b8dd9d43-1bc5-407a-a3c8-5c0d907dd54e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:26.630601 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c55db302-40ff-4aa9-8b7a-410f8c60a844 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:26.631311 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c55db302-40ff-4aa9-8b7a-410f8c60a844 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:26.639251 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c55db302-40ff-4aa9-8b7a-410f8c60a844 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:26.639756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c55db302-40ff-4aa9-8b7a-410f8c60a844 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:26.640551 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c55db302-40ff-4aa9-8b7a-410f8c60a844 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:26.641003 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c55db302-40ff-4aa9-8b7a-410f8c60a844 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:26.727642 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] validate_networks() for [('cf0db8bd-5a73-44bf-9367-58867c9e819f', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:31:26.845168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c55db302-40ff-4aa9-8b7a-410f8c60a844 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:26.854321 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c55db302-40ff-4aa9-8b7a-410f8c60a844 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.228235 May 28 14:31:26.855525 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 541/1076] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:26 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:26.876234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fed95bf5-0684-4eeb-a125-6f3374a45ade tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:26.877612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fed95bf5-0684-4eeb-a125-6f3374a45ade tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:26.885632 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fed95bf5-0684-4eeb-a125-6f3374a45ade tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:26.886380 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fed95bf5-0684-4eeb-a125-6f3374a45ade tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:26.887242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fed95bf5-0684-4eeb-a125-6f3374a45ade tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:26.887913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fed95bf5-0684-4eeb-a125-6f3374a45ade tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:27.070704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fed95bf5-0684-4eeb-a125-6f3374a45ade tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 14 microversion: 2.20 time: 0.198271 May 28 14:31:27.074099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 542/1077] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:26 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:27.504244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:31:27.504685 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:31:27.505177 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:31:27.505622 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:31:27.506046 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:31:27.514519 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:27.515257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:27.516107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:27.516552 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:27.534387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Getting quotas for project 26daec94fed843c8b74a9ff7d18ecdb5. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:31:27.538952 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Getting quotas for user b97d344e60d043dda3c4762eb75e08a8 and project 26daec94fed843c8b74a9ff7d18ecdb5. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:31:27.645667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:31:27.647834 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8dd9d43-1bc5-407a-a3c8-5c0d907dd54e',volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:31:27.872644 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:27.873613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:27.882101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:27.882549 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:27.883357 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:27.883826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:28.113986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:28.126878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.254986 May 28 14:31:28.126878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 543/1078] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:27 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:28.127145 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.671627 May 28 14:31:28.129889 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 536/1079] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:31:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:31:28.134278 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2e46daee-7b8f-4e2e-96dc-dd689c89dc39 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:28.135369 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2e46daee-7b8f-4e2e-96dc-dd689c89dc39 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:28.136536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-66803c76-e218-4351-8a0b-093a8daaabac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:28.137355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-66803c76-e218-4351-8a0b-093a8daaabac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:28.146054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e46daee-7b8f-4e2e-96dc-dd689c89dc39 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:28.147084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e46daee-7b8f-4e2e-96dc-dd689c89dc39 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:28.148162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e46daee-7b8f-4e2e-96dc-dd689c89dc39 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:28.148736 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e46daee-7b8f-4e2e-96dc-dd689c89dc39 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:28.225529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-66803c76-e218-4351-8a0b-093a8daaabac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:28.233516 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-66803c76-e218-4351-8a0b-093a8daaabac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1088 microversion: 2.1 time: 0.100622 May 28 14:31:28.234187 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 537/1080] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:28 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1088 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:28.251200 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2e46daee-7b8f-4e2e-96dc-dd689c89dc39 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 14 microversion: 2.20 time: 0.124989 May 28 14:31:28.252746 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 544/1081] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:28 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:29.140788 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5ecb3638-b861-4e60-9af0-9858d6430092 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:29.141408 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5ecb3638-b861-4e60-9af0-9858d6430092 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:29.148862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5ecb3638-b861-4e60-9af0-9858d6430092 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:29.149315 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5ecb3638-b861-4e60-9af0-9858d6430092 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:29.150095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5ecb3638-b861-4e60-9af0-9858d6430092 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:29.150538 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5ecb3638-b861-4e60-9af0-9858d6430092 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:29.251100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-69c7eee0-be19-42df-93f2-3ad1434c6745 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:29.252504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-69c7eee0-be19-42df-93f2-3ad1434c6745 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:29.325919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-69c7eee0-be19-42df-93f2-3ad1434c6745 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:29.333747 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-69c7eee0-be19-42df-93f2-3ad1434c6745 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1088 microversion: 2.1 time: 0.086932 May 28 14:31:29.334250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 545/1082] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:29 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1088 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:29.348417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-046a1330-78e1-4337-afba-9f0d1ed42d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:29.349345 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-046a1330-78e1-4337-afba-9f0d1ed42d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:29.356974 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5ecb3638-b861-4e60-9af0-9858d6430092 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:29.357532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-046a1330-78e1-4337-afba-9f0d1ed42d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:29.357999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-046a1330-78e1-4337-afba-9f0d1ed42d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:29.358835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-046a1330-78e1-4337-afba-9f0d1ed42d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:29.359288 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-046a1330-78e1-4337-afba-9f0d1ed42d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:29.365946 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5ecb3638-b861-4e60-9af0-9858d6430092 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.228876 May 28 14:31:29.366524 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 538/1083] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:29 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:29.455066 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-046a1330-78e1-4337-afba-9f0d1ed42d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 14 microversion: 2.20 time: 0.110405 May 28 14:31:29.455828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 546/1084] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:29 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:30.350986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-01c5983a-a701-4791-afa0-f23f7e230961 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:30.351697 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-01c5983a-a701-4791-afa0-f23f7e230961 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:30.359105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-01c5983a-a701-4791-afa0-f23f7e230961 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:30.359586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-01c5983a-a701-4791-afa0-f23f7e230961 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:30.360379 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-01c5983a-a701-4791-afa0-f23f7e230961 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:30.361460 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-01c5983a-a701-4791-afa0-f23f7e230961 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:30.382837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-58199a62-29f4-437e-991c-758f61c5b287 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:30.383734 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-58199a62-29f4-437e-991c-758f61c5b287 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:30.400335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58199a62-29f4-437e-991c-758f61c5b287 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:30.400335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58199a62-29f4-437e-991c-758f61c5b287 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:30.400335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58199a62-29f4-437e-991c-758f61c5b287 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:30.400335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58199a62-29f4-437e-991c-758f61c5b287 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:30.476370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-01c5983a-a701-4791-afa0-f23f7e230961 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:30.485003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-01c5983a-a701-4791-afa0-f23f7e230961 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1186 microversion: 2.1 time: 0.137731 May 28 14:31:30.486102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 539/1085] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:30 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1186 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:30.490810 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-81b77292-0175-4324-a884-f97e8a533bec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:30.492050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-81b77292-0175-4324-a884-f97e8a533bec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:30.500373 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-81b77292-0175-4324-a884-f97e8a533bec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:30.500831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-81b77292-0175-4324-a884-f97e8a533bec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:30.502262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-81b77292-0175-4324-a884-f97e8a533bec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:30.502702 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-81b77292-0175-4324-a884-f97e8a533bec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:30.604329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-81b77292-0175-4324-a884-f97e8a533bec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 4371 microversion: 2.20 time: 0.116883 May 28 14:31:30.607779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 540/1086] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:30 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 4371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:31:30.616248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-58199a62-29f4-437e-991c-758f61c5b287 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:30.625526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-58199a62-29f4-437e-991c-758f61c5b287 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.246726 May 28 14:31:30.626135 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 547/1087] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:30 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:31.503701 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4502371d-3058-46fe-b974-85b082ce64b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:31.504441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4502371d-3058-46fe-b974-85b082ce64b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:31.512586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4502371d-3058-46fe-b974-85b082ce64b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:31.513046 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4502371d-3058-46fe-b974-85b082ce64b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:31.514038 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4502371d-3058-46fe-b974-85b082ce64b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:31.514487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4502371d-3058-46fe-b974-85b082ce64b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:31.616738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d2a50bb7-1617-4031-a30e-741fde0cca62 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:31.617457 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d2a50bb7-1617-4031-a30e-741fde0cca62 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:31.625905 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2a50bb7-1617-4031-a30e-741fde0cca62 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:31.626420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2a50bb7-1617-4031-a30e-741fde0cca62 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:31.628315 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2a50bb7-1617-4031-a30e-741fde0cca62 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:31.629129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2a50bb7-1617-4031-a30e-741fde0cca62 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:31.740448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d2a50bb7-1617-4031-a30e-741fde0cca62 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 12677 microversion: 2.20 time: 0.127682 May 28 14:31:31.742969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 548/1088] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:31 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 12677 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:31.762572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:31.762572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:31.762572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:31.762572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:31.763169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:31.763169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:31.855095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4502371d-3058-46fe-b974-85b082ce64b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:31.864919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4502371d-3058-46fe-b974-85b082ce64b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1204 microversion: 2.1 time: 0.365939 May 28 14:31:31.865811 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 541/1089] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:31 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1204 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:32.182841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:32.191065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.446440 May 28 14:31:32.191646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 549/1090] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:31 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:32.754642 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-02ffb37b-62c3-4f1c-a412-c76e760f0bfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:32.755396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-02ffb37b-62c3-4f1c-a412-c76e760f0bfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:32.763140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02ffb37b-62c3-4f1c-a412-c76e760f0bfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:32.763632 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02ffb37b-62c3-4f1c-a412-c76e760f0bfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:32.764423 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02ffb37b-62c3-4f1c-a412-c76e760f0bfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:32.765164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-02ffb37b-62c3-4f1c-a412-c76e760f0bfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:32.873939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-02ffb37b-62c3-4f1c-a412-c76e760f0bfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 17509 microversion: 2.20 time: 0.123733 May 28 14:31:32.878277 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 542/1091] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:32 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 17509 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:32.882506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:32.883137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:32.890986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:32.891376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:32.892286 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:32.892736 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:33.208944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-56c04de9-b08f-43c4-bc12-8bfbe401f875 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:33.209649 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-56c04de9-b08f-43c4-bc12-8bfbe401f875 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:33.218132 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-56c04de9-b08f-43c4-bc12-8bfbe401f875 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:33.218589 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-56c04de9-b08f-43c4-bc12-8bfbe401f875 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:33.219377 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-56c04de9-b08f-43c4-bc12-8bfbe401f875 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:33.219844 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-56c04de9-b08f-43c4-bc12-8bfbe401f875 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:33.436158 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:33.445034 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1272 microversion: 2.1 time: 0.566204 May 28 14:31:33.446083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 550/1092] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:32 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1272 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:33.448070 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-56c04de9-b08f-43c4-bc12-8bfbe401f875 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:33.459284 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-56c04de9-b08f-43c4-bc12-8bfbe401f875 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.254831 May 28 14:31:33.459903 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 543/1093] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:33 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:33.886138 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-db534b31-8cb4-425d-832a-6c72e1b4b2d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:33.887051 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-db534b31-8cb4-425d-832a-6c72e1b4b2d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:33.895258 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db534b31-8cb4-425d-832a-6c72e1b4b2d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:33.895761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db534b31-8cb4-425d-832a-6c72e1b4b2d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:33.896561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db534b31-8cb4-425d-832a-6c72e1b4b2d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:33.900838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db534b31-8cb4-425d-832a-6c72e1b4b2d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:33.997296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-db534b31-8cb4-425d-832a-6c72e1b4b2d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 17931 microversion: 2.20 time: 0.114649 May 28 14:31:34.001268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 551/1094] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:33 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 17931 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:34.082068 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-a2d4c011-1ced-434e-b400-64c99a2eb158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2477e125-22c2-4367-b28c-0aaf5754b37c", "tag": "e27f7a0e-7e77-4d61-a393-fe4fde4153d5"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:34.083618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:34.083618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:31:34.091984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-a2d4c011-1ced-434e-b400-64c99a2eb158 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:34.092671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-a2d4c011-1ced-434e-b400-64c99a2eb158 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:34.114804 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-a2d4c011-1ced-434e-b400-64c99a2eb158 service nova] Creating event network-changed:e27f7a0e-7e77-4d61-a393-fe4fde4153d5 for instance 2477e125-22c2-4367-b28c-0aaf5754b37c on hv-cinder-79128 May 28 14:31:34.116522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-a2d4c011-1ced-434e-b400-64c99a2eb158 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043533 May 28 14:31:34.117233 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 544/1095] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:34.464590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:34.465306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:34.476473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:34.476968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-83465af3-217e-45d2-b67c-3a98470732d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:34.477624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:34.477752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-83465af3-217e-45d2-b67c-3a98470732d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:34.478879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:34.479325 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:34.491130 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-83465af3-217e-45d2-b67c-3a98470732d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:34.491700 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-83465af3-217e-45d2-b67c-3a98470732d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:34.492734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-83465af3-217e-45d2-b67c-3a98470732d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:34.493380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-83465af3-217e-45d2-b67c-3a98470732d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:34.713613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-83465af3-217e-45d2-b67c-3a98470732d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:34.724713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-83465af3-217e-45d2-b67c-3a98470732d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.252637 May 28 14:31:34.725293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 545/1096] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:34 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:34.792124 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:34.801313 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.342645 May 28 14:31:34.802232 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 552/1097] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:34 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:35.009148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-23ffcbea-441d-4574-bd66-bf40e9397c4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:35.010108 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-23ffcbea-441d-4574-bd66-bf40e9397c4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:35.018230 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23ffcbea-441d-4574-bd66-bf40e9397c4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:35.019096 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23ffcbea-441d-4574-bd66-bf40e9397c4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:35.019636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23ffcbea-441d-4574-bd66-bf40e9397c4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:35.020025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23ffcbea-441d-4574-bd66-bf40e9397c4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:35.129798 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-23ffcbea-441d-4574-bd66-bf40e9397c4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 19342 microversion: 2.20 time: 0.124142 May 28 14:31:35.133849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 546/1098] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:35 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 19342 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:35.741182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e063ae7a-6ec2-4cae-a506-4777a61833e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:35.742031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e063ae7a-6ec2-4cae-a506-4777a61833e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:35.750512 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e063ae7a-6ec2-4cae-a506-4777a61833e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:35.751056 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e063ae7a-6ec2-4cae-a506-4777a61833e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:35.752630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e063ae7a-6ec2-4cae-a506-4777a61833e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:35.753155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e063ae7a-6ec2-4cae-a506-4777a61833e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:35.819771 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-80db9b66-d4d8-44c7-aa03-b200283f762a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:35.820683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-80db9b66-d4d8-44c7-aa03-b200283f762a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:35.828781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-80db9b66-d4d8-44c7-aa03-b200283f762a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:35.829340 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-80db9b66-d4d8-44c7-aa03-b200283f762a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:35.830299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-80db9b66-d4d8-44c7-aa03-b200283f762a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:35.830848 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-80db9b66-d4d8-44c7-aa03-b200283f762a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:35.963488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e063ae7a-6ec2-4cae-a506-4777a61833e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:35.973822 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e063ae7a-6ec2-4cae-a506-4777a61833e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.236309 May 28 14:31:35.974707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 553/1099] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:35 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:36.112859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-80db9b66-d4d8-44c7-aa03-b200283f762a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:36.120934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-80db9b66-d4d8-44c7-aa03-b200283f762a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.305585 May 28 14:31:36.121497 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 547/1100] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:35 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:36.140720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-668dedd7-9037-456b-b785-40143c4afb28 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:36.141652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-668dedd7-9037-456b-b785-40143c4afb28 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:36.148901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-668dedd7-9037-456b-b785-40143c4afb28 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:36.149301 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-668dedd7-9037-456b-b785-40143c4afb28 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:36.150091 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-668dedd7-9037-456b-b785-40143c4afb28 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:36.150590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-668dedd7-9037-456b-b785-40143c4afb28 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:36.392936 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-668dedd7-9037-456b-b785-40143c4afb28 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 22205 microversion: 2.20 time: 0.255771 May 28 14:31:36.393566 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 554/1101] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:36 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 22205 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:36.991393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a42a8832-bb51-44d6-9e96-4816310d1f93 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:36.992083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a42a8832-bb51-44d6-9e96-4816310d1f93 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:36.999988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a42a8832-bb51-44d6-9e96-4816310d1f93 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:37.000447 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a42a8832-bb51-44d6-9e96-4816310d1f93 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:37.001745 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a42a8832-bb51-44d6-9e96-4816310d1f93 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:37.002164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a42a8832-bb51-44d6-9e96-4816310d1f93 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:37.138385 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8320b661-5224-4f1e-9711-8b9bc95b1b36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:37.139812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8320b661-5224-4f1e-9711-8b9bc95b1b36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:37.148427 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8320b661-5224-4f1e-9711-8b9bc95b1b36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:37.148882 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8320b661-5224-4f1e-9711-8b9bc95b1b36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:37.149668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8320b661-5224-4f1e-9711-8b9bc95b1b36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:37.150106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8320b661-5224-4f1e-9711-8b9bc95b1b36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:37.206121 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a42a8832-bb51-44d6-9e96-4816310d1f93 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:37.214235 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a42a8832-bb51-44d6-9e96-4816310d1f93 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.226575 May 28 14:31:37.214816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 548/1102] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:36 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:37.349157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8320b661-5224-4f1e-9711-8b9bc95b1b36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:37.357742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8320b661-5224-4f1e-9711-8b9bc95b1b36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.223398 May 28 14:31:37.369170 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 555/1103] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:37 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:37.405502 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f0b00462-ed09-472d-86d1-94806db99286 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:37.406418 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f0b00462-ed09-472d-86d1-94806db99286 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:37.413687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0b00462-ed09-472d-86d1-94806db99286 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:37.414141 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0b00462-ed09-472d-86d1-94806db99286 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:37.414931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0b00462-ed09-472d-86d1-94806db99286 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:37.415351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0b00462-ed09-472d-86d1-94806db99286 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:37.545035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f0b00462-ed09-472d-86d1-94806db99286 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 23221 microversion: 2.20 time: 0.143004 May 28 14:31:37.545688 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 549/1104] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:37 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 23221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:38.230683 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:38.231305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:38.239057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:38.239510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:38.240332 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:38.240777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:38.387137 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b0eae71c-1b72-4473-b672-c7cb6be88265 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:38.387970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b0eae71c-1b72-4473-b672-c7cb6be88265 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:38.397405 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b0eae71c-1b72-4473-b672-c7cb6be88265 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:38.397902 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b0eae71c-1b72-4473-b672-c7cb6be88265 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:38.398826 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b0eae71c-1b72-4473-b672-c7cb6be88265 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:38.399347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b0eae71c-1b72-4473-b672-c7cb6be88265 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:38.437149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:38.446247 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.219206 May 28 14:31:38.447229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 556/1105] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:38 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:38.557541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ff8f6f9e-2063-4885-9094-55ec4c61f2a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:38.558504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ff8f6f9e-2063-4885-9094-55ec4c61f2a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:38.567112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff8f6f9e-2063-4885-9094-55ec4c61f2a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:38.567636 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff8f6f9e-2063-4885-9094-55ec4c61f2a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:38.568562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff8f6f9e-2063-4885-9094-55ec4c61f2a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:38.569085 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff8f6f9e-2063-4885-9094-55ec4c61f2a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:38.599945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b0eae71c-1b72-4473-b672-c7cb6be88265 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:38.608319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b0eae71c-1b72-4473-b672-c7cb6be88265 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.225729 May 28 14:31:38.608888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 550/1106] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:38 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:38.674825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ff8f6f9e-2063-4885-9094-55ec4c61f2a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 24629 microversion: 2.20 time: 0.121001 May 28 14:31:38.678720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 557/1107] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:38 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 24629 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:38.803062 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-964ccb51-c176-4a13-b6dc-11a82054ea42 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1793117328"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:38.803690 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-964ccb51-c176-4a13-b6dc-11a82054ea42 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:38.811904 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-964ccb51-c176-4a13-b6dc-11a82054ea42 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:38.812370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-964ccb51-c176-4a13-b6dc-11a82054ea42 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:38.813160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-964ccb51-c176-4a13-b6dc-11a82054ea42 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:38.813601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-964ccb51-c176-4a13-b6dc-11a82054ea42 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:39.008781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.network.security_group_api [None req-964ccb51-c176-4a13-b6dc-11a82054ea42 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Removing security group 3d863428-3f5e-4b80-a607-bbb4325e640a from port 164fd7c8-7a57-4285-93ef-c3fdabceb8be May 28 14:31:39.464925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9fad7796-dadc-4f70-8c58-531a6abd0638 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:39.465615 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9fad7796-dadc-4f70-8c58-531a6abd0638 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:39.474161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9fad7796-dadc-4f70-8c58-531a6abd0638 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:39.474615 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9fad7796-dadc-4f70-8c58-531a6abd0638 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:39.475404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9fad7796-dadc-4f70-8c58-531a6abd0638 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:39.475867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9fad7796-dadc-4f70-8c58-531a6abd0638 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:39.546396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-964ccb51-c176-4a13-b6dc-11a82054ea42 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/action" status: 202 len: 0 microversion: 2.1 time: 0.930459 May 28 14:31:39.547394 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 551/1108] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:31:38 2021] POST /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/action => generated 0 bytes in 932 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:39.558135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-1b341b7e-7a16-40f6-b152-03a93cf4a6bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4", "tag": "164fd7c8-7a57-4285-93ef-c3fdabceb8be"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:39.560015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:39.560015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:31:39.573884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-1b341b7e-7a16-40f6-b152-03a93cf4a6bb service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:39.574346 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-1b341b7e-7a16-40f6-b152-03a93cf4a6bb service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:39.621851 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-1b341b7e-7a16-40f6-b152-03a93cf4a6bb service nova] Creating event network-changed:164fd7c8-7a57-4285-93ef-c3fdabceb8be for instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 on hv-cinder-79128 May 28 14:31:39.627393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-1b341b7e-7a16-40f6-b152-03a93cf4a6bb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072896 May 28 14:31:39.628257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 552/1109] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:31:39.633574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9dcb9358-3729-4a15-80cd-acc34e88eb94 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:39.637906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9dcb9358-3729-4a15-80cd-acc34e88eb94 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:39.652850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9dcb9358-3729-4a15-80cd-acc34e88eb94 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:39.652850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9dcb9358-3729-4a15-80cd-acc34e88eb94 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:39.653157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9dcb9358-3729-4a15-80cd-acc34e88eb94 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:39.660353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9dcb9358-3729-4a15-80cd-acc34e88eb94 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:39.834416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9fad7796-dadc-4f70-8c58-531a6abd0638 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:39.834416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9fad7796-dadc-4f70-8c58-531a6abd0638 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.371598 May 28 14:31:39.837549 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 558/1110] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:39 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:39.851055 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-4638c569-1e7c-4710-8fed-5463a69192a8 req-e79c12ac-00b5-4949-b372-33e2e8d6bf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44daf467-480b-40ee-8e1b-567ea8d285ee", "name": "network-vif-plugged", "status": "completed", "tag": "a1d19f37-64ae-4f18-a8f2-79559df44a3b"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:39.853010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:39.853010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:31:39.876978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-4638c569-1e7c-4710-8fed-5463a69192a8 req-e79c12ac-00b5-4949-b372-33e2e8d6bf25 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:39.878364 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-4638c569-1e7c-4710-8fed-5463a69192a8 req-e79c12ac-00b5-4949-b372-33e2e8d6bf25 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:39.917564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-4638c569-1e7c-4710-8fed-5463a69192a8 req-e79c12ac-00b5-4949-b372-33e2e8d6bf25 service nova] Creating event network-vif-plugged:a1d19f37-64ae-4f18-a8f2-79559df44a3b for instance 44daf467-480b-40ee-8e1b-567ea8d285ee on hv-cinder-79128 May 28 14:31:39.923950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-4638c569-1e7c-4710-8fed-5463a69192a8 req-e79c12ac-00b5-4949-b372-33e2e8d6bf25 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084282 May 28 14:31:39.924919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 559/1111] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:39.931067 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-82dca623-7169-45fe-884e-e661d4d4c219 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:39.932712 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-82dca623-7169-45fe-884e-e661d4d4c219 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:39.941175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-82dca623-7169-45fe-884e-e661d4d4c219 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:39.942012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-82dca623-7169-45fe-884e-e661d4d4c219 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:39.943071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-82dca623-7169-45fe-884e-e661d4d4c219 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:39.943763 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-82dca623-7169-45fe-884e-e661d4d4c219 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:40.088276 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9dcb9358-3729-4a15-80cd-acc34e88eb94 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:40.096031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-82dca623-7169-45fe-884e-e661d4d4c219 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 26351 microversion: 2.20 time: 0.168441 May 28 14:31:40.102312 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 560/1112] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:39 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 26351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:40.102546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9dcb9358-3729-4a15-80cd-acc34e88eb94 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.469652 May 28 14:31:40.102546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 553/1113] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:39 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:40.854885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b70ec0bc-0471-46c8-a765-ccde80e64f8e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:40.855795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b70ec0bc-0471-46c8-a765-ccde80e64f8e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:40.868373 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b70ec0bc-0471-46c8-a765-ccde80e64f8e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:40.868910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b70ec0bc-0471-46c8-a765-ccde80e64f8e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:40.869752 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b70ec0bc-0471-46c8-a765-ccde80e64f8e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:40.870251 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b70ec0bc-0471-46c8-a765-ccde80e64f8e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:41.094009 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b70ec0bc-0471-46c8-a765-ccde80e64f8e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:41.100594 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b70ec0bc-0471-46c8-a765-ccde80e64f8e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.250214 May 28 14:31:41.102832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 561/1114] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:40 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:41.107744 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3311bf90-0d18-496b-b888-f9facff763e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:41.108876 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3311bf90-0d18-496b-b888-f9facff763e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:41.116262 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:41.117191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:41.118050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3311bf90-0d18-496b-b888-f9facff763e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:41.118582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3311bf90-0d18-496b-b888-f9facff763e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:41.119483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3311bf90-0d18-496b-b888-f9facff763e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:41.120030 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3311bf90-0d18-496b-b888-f9facff763e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:41.125094 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:41.125562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:41.127332 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:41.127817 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:41.220699 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3311bf90-0d18-496b-b888-f9facff763e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 27295 microversion: 2.20 time: 0.116240 May 28 14:31:41.221429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 554/1115] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:41 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 27295 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:41.334337 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:41.344310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.231256 May 28 14:31:41.351160 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 562/1116] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:41 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:42.118550 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0381605a-8d81-49c7-a857-8b162005d0bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:42.119382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0381605a-8d81-49c7-a857-8b162005d0bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:42.128324 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0381605a-8d81-49c7-a857-8b162005d0bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.129041 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0381605a-8d81-49c7-a857-8b162005d0bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.130226 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0381605a-8d81-49c7-a857-8b162005d0bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.130968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0381605a-8d81-49c7-a857-8b162005d0bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.155643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2efc6f68-5120-4329-aabd-24edefc9474b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:42.156528 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2efc6f68-5120-4329-aabd-24edefc9474b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:42.166132 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2efc6f68-5120-4329-aabd-24edefc9474b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.166759 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2efc6f68-5120-4329-aabd-24edefc9474b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.167688 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2efc6f68-5120-4329-aabd-24edefc9474b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.168201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2efc6f68-5120-4329-aabd-24edefc9474b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.337056 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-2efc6f68-5120-4329-aabd-24edefc9474b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lazy-loading 'services' on Instance uuid 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:31:42.344076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0381605a-8d81-49c7-a857-8b162005d0bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:42.353411 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0381605a-8d81-49c7-a857-8b162005d0bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.239048 May 28 14:31:42.363612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 555/1117] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:42 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:42.363612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-4db207b3-6964-4e32-bd0f-a6a08087ab96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4", "tag": "164fd7c8-7a57-4285-93ef-c3fdabceb8be"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:42.363612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:42.363612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:31:42.370782 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-4db207b3-6964-4e32-bd0f-a6a08087ab96 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.371237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-4db207b3-6964-4e32-bd0f-a6a08087ab96 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.388229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-4db207b3-6964-4e32-bd0f-a6a08087ab96 service nova] Creating event network-changed:164fd7c8-7a57-4285-93ef-c3fdabceb8be for instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 on hv-cinder-79128 May 28 14:31:42.393001 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-4db207b3-6964-4e32-bd0f-a6a08087ab96 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037306 May 28 14:31:42.393766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 556/1118] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:42.399007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7b5547d6-63eb-44d6-ac66-efb46bf81847 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:42.400069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7b5547d6-63eb-44d6-ac66-efb46bf81847 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:42.408565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b5547d6-63eb-44d6-ac66-efb46bf81847 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.409567 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b5547d6-63eb-44d6-ac66-efb46bf81847 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.410855 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b5547d6-63eb-44d6-ac66-efb46bf81847 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.411995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b5547d6-63eb-44d6-ac66-efb46bf81847 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.711637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2efc6f68-5120-4329-aabd-24edefc9474b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments/e44c1036-d0bf-4943-932a-fe3f5b7601a1" status: 202 len: 0 microversion: 2.1 time: 0.561013 May 28 14:31:42.712243 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 563/1119] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:31:42 2021] DELETE /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments/e44c1036-d0bf-4943-932a-fe3f5b7601a1 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:42.717741 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-98cb76db-6928-424b-9c57-8d6ce3790fe9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:42.723094 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-98cb76db-6928-424b-9c57-8d6ce3790fe9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:42.727128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-98cb76db-6928-424b-9c57-8d6ce3790fe9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.727635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-98cb76db-6928-424b-9c57-8d6ce3790fe9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.728544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-98cb76db-6928-424b-9c57-8d6ce3790fe9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.728975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-98cb76db-6928-424b-9c57-8d6ce3790fe9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.943302 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-98cb76db-6928-424b-9c57-8d6ce3790fe9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:42.951643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-98cb76db-6928-424b-9c57-8d6ce3790fe9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.238191 May 28 14:31:42.952219 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 564/1120] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:42 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:42.957444 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5ebe720f-0d42-4f31-a3ed-02d8cdb639e9 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:42.958408 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5ebe720f-0d42-4f31-a3ed-02d8cdb639e9 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:42.965601 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ebe720f-0d42-4f31-a3ed-02d8cdb639e9 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.966059 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ebe720f-0d42-4f31-a3ed-02d8cdb639e9 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:42.966848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ebe720f-0d42-4f31-a3ed-02d8cdb639e9 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:42.967365 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ebe720f-0d42-4f31-a3ed-02d8cdb639e9 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:43.032085 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5ebe720f-0d42-4f31-a3ed-02d8cdb639e9 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078739 May 28 14:31:43.032667 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 565/1121] 10.222.0.59 () {58 vars in 1302 bytes} [Fri May 28 14:31:42 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:43.372532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f0e74f35-a0c1-47f7-b71e-a989ce318fae tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:43.373510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f0e74f35-a0c1-47f7-b71e-a989ce318fae tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:43.381439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0e74f35-a0c1-47f7-b71e-a989ce318fae tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:43.381898 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0e74f35-a0c1-47f7-b71e-a989ce318fae tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:43.382912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0e74f35-a0c1-47f7-b71e-a989ce318fae tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:43.383493 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0e74f35-a0c1-47f7-b71e-a989ce318fae tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:43.672303 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f0e74f35-a0c1-47f7-b71e-a989ce318fae tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:43.681353 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f0e74f35-a0c1-47f7-b71e-a989ce318fae tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.312582 May 28 14:31:43.681937 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 566/1122] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:43 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:43.970375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8e8c60bf-6264-403b-9161-e6ca149a79dd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:43.971004 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8e8c60bf-6264-403b-9161-e6ca149a79dd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:43.978508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8e8c60bf-6264-403b-9161-e6ca149a79dd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:43.978970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8e8c60bf-6264-403b-9161-e6ca149a79dd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:43.979806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8e8c60bf-6264-403b-9161-e6ca149a79dd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:43.980256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8e8c60bf-6264-403b-9161-e6ca149a79dd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:44.173693 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8e8c60bf-6264-403b-9161-e6ca149a79dd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:44.182312 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8e8c60bf-6264-403b-9161-e6ca149a79dd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.216271 May 28 14:31:44.182877 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 567/1123] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:43 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:44.187334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8cbd2ae7-28b0-445c-8ce6-aea7b398ec1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:44.188290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8cbd2ae7-28b0-445c-8ce6-aea7b398ec1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:44.195631 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cbd2ae7-28b0-445c-8ce6-aea7b398ec1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:44.196096 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cbd2ae7-28b0-445c-8ce6-aea7b398ec1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:44.196908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cbd2ae7-28b0-445c-8ce6-aea7b398ec1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:44.197345 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cbd2ae7-28b0-445c-8ce6-aea7b398ec1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:44.261384 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8cbd2ae7-28b0-445c-8ce6-aea7b398ec1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077401 May 28 14:31:44.261863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 568/1124] 10.222.0.59 () {58 vars in 1302 bytes} [Fri May 28 14:31:44 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:44.697292 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:44.697944 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:44.705336 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:44.705800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:44.706595 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:44.707047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:44.904464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:44.913175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.219691 May 28 14:31:44.913737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 569/1125] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:44 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:45.199157 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:45.199833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:45.207770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:45.208234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:45.209016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:45.209465 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:45.561442 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:45.570420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.374947 May 28 14:31:45.574074 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 570/1126] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:45 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:45.575951 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ec278df9-69c3-4f48-b902-ff846fd3faa7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:45.576889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ec278df9-69c3-4f48-b902-ff846fd3faa7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:45.584709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec278df9-69c3-4f48-b902-ff846fd3faa7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:45.585199 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec278df9-69c3-4f48-b902-ff846fd3faa7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:45.586046 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec278df9-69c3-4f48-b902-ff846fd3faa7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:45.586495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec278df9-69c3-4f48-b902-ff846fd3faa7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:45.653187 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ec278df9-69c3-4f48-b902-ff846fd3faa7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080631 May 28 14:31:45.653779 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 571/1127] 10.222.0.59 () {58 vars in 1302 bytes} [Fri May 28 14:31:45 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:45.789933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7b5547d6-63eb-44d6-ac66-efb46bf81847 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 27823 microversion: 2.20 time: 3.394810 May 28 14:31:45.790609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 557/1128] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:42 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 27823 bytes in 3396 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:45.929913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-845cebbf-7331-464b-b8e1-e745688fb567 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:45.930653 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-845cebbf-7331-464b-b8e1-e745688fb567 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:45.938214 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-845cebbf-7331-464b-b8e1-e745688fb567 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:45.938602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-845cebbf-7331-464b-b8e1-e745688fb567 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:45.939545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-845cebbf-7331-464b-b8e1-e745688fb567 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:45.940025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-845cebbf-7331-464b-b8e1-e745688fb567 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:46.237093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-845cebbf-7331-464b-b8e1-e745688fb567 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:46.245360 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-845cebbf-7331-464b-b8e1-e745688fb567 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1266 microversion: 2.1 time: 0.319130 May 28 14:31:46.245999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 572/1129] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:45 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:46.588836 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cd9a426a-7dd5-4aea-989a-847115379827 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:46.589470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cd9a426a-7dd5-4aea-989a-847115379827 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:46.599774 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd9a426a-7dd5-4aea-989a-847115379827 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:46.600260 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd9a426a-7dd5-4aea-989a-847115379827 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:46.601251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd9a426a-7dd5-4aea-989a-847115379827 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:46.601696 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cd9a426a-7dd5-4aea-989a-847115379827 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:46.665017 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3b84815f-1496-4dac-af76-b6d084a29365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:46.665943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3b84815f-1496-4dac-af76-b6d084a29365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:46.674897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b84815f-1496-4dac-af76-b6d084a29365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:46.675694 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b84815f-1496-4dac-af76-b6d084a29365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:46.676182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b84815f-1496-4dac-af76-b6d084a29365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:46.676869 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b84815f-1496-4dac-af76-b6d084a29365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:46.745951 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3b84815f-1496-4dac-af76-b6d084a29365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084893 May 28 14:31:46.746535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 573/1130] 10.222.0.59 () {58 vars in 1302 bytes} [Fri May 28 14:31:46 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:31:46.802679 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9928fa45-20f1-4058-8ec8-23ae5caa1cfa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:46.803825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9928fa45-20f1-4058-8ec8-23ae5caa1cfa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:46.811425 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9928fa45-20f1-4058-8ec8-23ae5caa1cfa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:46.811922 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9928fa45-20f1-4058-8ec8-23ae5caa1cfa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:46.812739 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9928fa45-20f1-4058-8ec8-23ae5caa1cfa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:46.813872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9928fa45-20f1-4058-8ec8-23ae5caa1cfa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:46.821709 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cd9a426a-7dd5-4aea-989a-847115379827 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:46.833680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cd9a426a-7dd5-4aea-989a-847115379827 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.249189 May 28 14:31:46.834443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 558/1131] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:46 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:46.931984 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9928fa45-20f1-4058-8ec8-23ae5caa1cfa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 27950 microversion: 2.20 time: 0.133338 May 28 14:31:46.933748 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 574/1132] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:46 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 27950 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:47.262173 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-af4e710f-7db7-4298-b288-790b7b27d957 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:47.262940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-af4e710f-7db7-4298-b288-790b7b27d957 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:47.270149 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af4e710f-7db7-4298-b288-790b7b27d957 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:47.270601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af4e710f-7db7-4298-b288-790b7b27d957 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.271367 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af4e710f-7db7-4298-b288-790b7b27d957 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:47.271835 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-af4e710f-7db7-4298-b288-790b7b27d957 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.470478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-af4e710f-7db7-4298-b288-790b7b27d957 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:47.479268 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-af4e710f-7db7-4298-b288-790b7b27d957 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1453 microversion: 2.1 time: 0.220763 May 28 14:31:47.480101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 559/1133] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:47 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:47.496388 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7c001614-fe05-458d-bba4-1c52072b8385 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:47.497097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7c001614-fe05-458d-bba4-1c52072b8385 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:47.505317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c001614-fe05-458d-bba4-1c52072b8385 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:47.505781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c001614-fe05-458d-bba4-1c52072b8385 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.506574 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c001614-fe05-458d-bba4-1c52072b8385 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:47.507018 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c001614-fe05-458d-bba4-1c52072b8385 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.711305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7c001614-fe05-458d-bba4-1c52072b8385 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:47.720305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7c001614-fe05-458d-bba4-1c52072b8385 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1453 microversion: 2.1 time: 0.227357 May 28 14:31:47.720874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 575/1134] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:47 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:47.757128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8bc892b6-fa26-4299-b32c-44b20ed1de88 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:47.758059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8bc892b6-fa26-4299-b32c-44b20ed1de88 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:47.765834 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8bc892b6-fa26-4299-b32c-44b20ed1de88 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:47.766928 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8bc892b6-fa26-4299-b32c-44b20ed1de88 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.767616 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8bc892b6-fa26-4299-b32c-44b20ed1de88 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:47.768069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8bc892b6-fa26-4299-b32c-44b20ed1de88 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.850797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:47.851426 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:47.859020 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:47.859489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.860385 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:47.860833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.991343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8bc892b6-fa26-4299-b32c-44b20ed1de88 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.238003 May 28 14:31:47.992550 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 560/1135] 10.222.0.59 () {58 vars in 1302 bytes} [Fri May 28 14:31:47 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments => generated 25 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:31:47.997202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-39eefe5b-3f9c-4460-8e6b-b0a7c8c301d6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:47.998456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-39eefe5b-3f9c-4460-8e6b-b0a7c8c301d6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:48.006160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39eefe5b-3f9c-4460-8e6b-b0a7c8c301d6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:48.006623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39eefe5b-3f9c-4460-8e6b-b0a7c8c301d6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:48.007421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39eefe5b-3f9c-4460-8e6b-b0a7c8c301d6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:48.011603 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-39eefe5b-3f9c-4460-8e6b-b0a7c8c301d6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:48.110556 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-39eefe5b-3f9c-4460-8e6b-b0a7c8c301d6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28068 microversion: 2.20 time: 0.116054 May 28 14:31:48.111214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 561/1136] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:47 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28068 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:48.119658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:48.120265 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:48.130640 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:48.131123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:48.131951 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:48.132398 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:48.224590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:48.233832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.386663 May 28 14:31:48.243783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 576/1137] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:47 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:48.339512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] HTTP exception thrown: Instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 is not attached to volume e44c1036-d0bf-4943-932a-fe3f5b7601a1 May 28 14:31:48.340677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Returning 404 to user: Instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 is not attached to volume e44c1036-d0bf-4943-932a-fe3f5b7601a1 {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:31:48.341635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2eff4df5-2811-4055-ab80-66e8f848750a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments/e44c1036-d0bf-4943-932a-fe3f5b7601a1" status: 404 len: 154 microversion: 2.1 time: 0.228260 May 28 14:31:48.342522 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 562/1138] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:31:48 2021] DELETE /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4/os-volume_attachments/e44c1036-d0bf-4943-932a-fe3f5b7601a1 => generated 154 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:31:49.122290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a9a88ca6-0fbe-480f-a5e0-cbe9a33c14aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:49.123532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a9a88ca6-0fbe-480f-a5e0-cbe9a33c14aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:49.131799 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9a88ca6-0fbe-480f-a5e0-cbe9a33c14aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:49.132270 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9a88ca6-0fbe-480f-a5e0-cbe9a33c14aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:49.133063 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9a88ca6-0fbe-480f-a5e0-cbe9a33c14aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:49.133511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9a88ca6-0fbe-480f-a5e0-cbe9a33c14aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:49.251521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:49.252278 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:49.261308 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:49.261852 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:49.262711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:49.263249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:49.375507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a9a88ca6-0fbe-480f-a5e0-cbe9a33c14aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.256613 May 28 14:31:49.376742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 577/1139] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:49 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:49.470850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:49.479255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.232647 May 28 14:31:49.480248 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 563/1140] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:49 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:31:49.607899 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-a13a1738-a68c-4e43-9288-3a43eb61b48a req-d3325251-6449-4925-81a6-dfe49604993f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2477e125-22c2-4367-b28c-0aaf5754b37c", "name": "network-vif-plugged", "status": "completed", "tag": "e27f7a0e-7e77-4d61-a393-fe4fde4153d5"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:49.612416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:49.612416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:31:49.619287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-a13a1738-a68c-4e43-9288-3a43eb61b48a req-d3325251-6449-4925-81a6-dfe49604993f service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:49.619790 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-a13a1738-a68c-4e43-9288-3a43eb61b48a req-d3325251-6449-4925-81a6-dfe49604993f service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:49.635630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-a13a1738-a68c-4e43-9288-3a43eb61b48a req-d3325251-6449-4925-81a6-dfe49604993f service nova] Creating event network-vif-plugged:e27f7a0e-7e77-4d61-a393-fe4fde4153d5 for instance 2477e125-22c2-4367-b28c-0aaf5754b37c on hv-cinder-79128 May 28 14:31:49.642306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-a13a1738-a68c-4e43-9288-3a43eb61b48a req-d3325251-6449-4925-81a6-dfe49604993f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039813 May 28 14:31:49.645912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 578/1141] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:49.834196 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:49.834698 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:49.841886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:49.842331 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:49.843113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:49.843544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:49.905164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:31:50.376653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 204 len: 0 microversion: 2.1 time: 0.545302 May 28 14:31:50.377500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 564/1142] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:31:49 2021] DELETE /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:31:50.393908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-becefc52-cc72-42ce-9115-df318b62d814 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:50.393908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-becefc52-cc72-42ce-9115-df318b62d814 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:50.394704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-48cdc66b-4b2b-4c36-96de-d2e8f4f78103 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:50.394704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-48cdc66b-4b2b-4c36-96de-d2e8f4f78103 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:50.398581 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-becefc52-cc72-42ce-9115-df318b62d814 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:50.399297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-becefc52-cc72-42ce-9115-df318b62d814 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:50.400829 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-becefc52-cc72-42ce-9115-df318b62d814 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:50.401635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-becefc52-cc72-42ce-9115-df318b62d814 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:50.404875 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-48cdc66b-4b2b-4c36-96de-d2e8f4f78103 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:50.405788 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-48cdc66b-4b2b-4c36-96de-d2e8f4f78103 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:50.406648 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-48cdc66b-4b2b-4c36-96de-d2e8f4f78103 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:50.407381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-48cdc66b-4b2b-4c36-96de-d2e8f4f78103 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:50.665002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-48cdc66b-4b2b-4c36-96de-d2e8f4f78103 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.280699 May 28 14:31:50.665656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 565/1143] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:50 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:50.670965 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:50.671708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:50.683909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:50.684372 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:50.685162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:50.685780 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:50.843334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-becefc52-cc72-42ce-9115-df318b62d814 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:50.853186 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-becefc52-cc72-42ce-9115-df318b62d814 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1555 microversion: 2.1 time: 0.469990 May 28 14:31:50.863064 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 579/1144] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:50 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1555 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:51.056938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:51.066922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1260 microversion: 2.1 time: 0.399884 May 28 14:31:51.067642 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 566/1145] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:50 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1260 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:51.234317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-0f3605fd-546e-443a-b78d-702b3dd11e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44daf467-480b-40ee-8e1b-567ea8d285ee", "tag": "a1d19f37-64ae-4f18-a8f2-79559df44a3b"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:51.236054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:51.236054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:31:51.244367 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-0f3605fd-546e-443a-b78d-702b3dd11e7d service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:51.247809 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-0f3605fd-546e-443a-b78d-702b3dd11e7d service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:51.262520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-0f3605fd-546e-443a-b78d-702b3dd11e7d service nova] Creating event network-changed:a1d19f37-64ae-4f18-a8f2-79559df44a3b for instance 44daf467-480b-40ee-8e1b-567ea8d285ee on hv-cinder-79128 May 28 14:31:51.268795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-0f3605fd-546e-443a-b78d-702b3dd11e7d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163642 May 28 14:31:51.269423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 580/1146] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:51.677711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bfe15bda-a85f-462a-b17a-2dd24aea78a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:51.678643 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bfe15bda-a85f-462a-b17a-2dd24aea78a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:51.686767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfe15bda-a85f-462a-b17a-2dd24aea78a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:51.687230 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfe15bda-a85f-462a-b17a-2dd24aea78a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:51.688630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfe15bda-a85f-462a-b17a-2dd24aea78a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:51.689370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfe15bda-a85f-462a-b17a-2dd24aea78a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:51.801813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bfe15bda-a85f-462a-b17a-2dd24aea78a8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.127253 May 28 14:31:51.802944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 567/1147] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:51 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:51.874229 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8e3713f9-4968-467a-b8ac-8f8ea509cada tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:51.876802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8e3713f9-4968-467a-b8ac-8f8ea509cada tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:51.888289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8e3713f9-4968-467a-b8ac-8f8ea509cada tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:51.889721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8e3713f9-4968-467a-b8ac-8f8ea509cada tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:51.891214 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8e3713f9-4968-467a-b8ac-8f8ea509cada tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:51.891800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8e3713f9-4968-467a-b8ac-8f8ea509cada tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:52.084888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1a9298a7-6596-432f-85d1-0560a9309f9d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:52.086174 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1a9298a7-6596-432f-85d1-0560a9309f9d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:52.096475 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1a9298a7-6596-432f-85d1-0560a9309f9d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:52.097012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1a9298a7-6596-432f-85d1-0560a9309f9d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:52.097850 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1a9298a7-6596-432f-85d1-0560a9309f9d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:52.098297 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1a9298a7-6596-432f-85d1-0560a9309f9d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:52.247068 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8e3713f9-4968-467a-b8ac-8f8ea509cada tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:52.258731 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8e3713f9-4968-467a-b8ac-8f8ea509cada tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1555 microversion: 2.1 time: 0.391752 May 28 14:31:52.259361 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 581/1148] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:51 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1555 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:52.350976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1a9298a7-6596-432f-85d1-0560a9309f9d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:52.359948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1a9298a7-6596-432f-85d1-0560a9309f9d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1442 microversion: 2.1 time: 0.279487 May 28 14:31:52.360536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 568/1149] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:52 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1442 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:52.376639 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8cce8864-eea5-4626-9680-d360577d8db2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:52.377307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8cce8864-eea5-4626-9680-d360577d8db2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:52.385169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cce8864-eea5-4626-9680-d360577d8db2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:52.385688 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cce8864-eea5-4626-9680-d360577d8db2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:52.386529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cce8864-eea5-4626-9680-d360577d8db2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:52.387086 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8cce8864-eea5-4626-9680-d360577d8db2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:52.706072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8cce8864-eea5-4626-9680-d360577d8db2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:52.714406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8cce8864-eea5-4626-9680-d360577d8db2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1442 microversion: 2.1 time: 0.341838 May 28 14:31:52.714967 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 582/1150] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:52 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1442 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:52.815975 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-acc22025-7fb2-4b26-b8b6-f650b26374f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:52.816915 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-acc22025-7fb2-4b26-b8b6-f650b26374f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:52.824147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acc22025-7fb2-4b26-b8b6-f650b26374f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:52.824598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acc22025-7fb2-4b26-b8b6-f650b26374f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:52.825382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acc22025-7fb2-4b26-b8b6-f650b26374f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:52.825822 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-acc22025-7fb2-4b26-b8b6-f650b26374f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:52.931693 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-acc22025-7fb2-4b26-b8b6-f650b26374f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.119609 May 28 14:31:52.933092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 569/1151] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:52 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:53.276025 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c1293529-f283-4c72-9909-07a9ff09b4c6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:53.276822 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c1293529-f283-4c72-9909-07a9ff09b4c6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:53.285045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1293529-f283-4c72-9909-07a9ff09b4c6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:53.285597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1293529-f283-4c72-9909-07a9ff09b4c6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:53.286455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1293529-f283-4c72-9909-07a9ff09b4c6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:53.286980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c1293529-f283-4c72-9909-07a9ff09b4c6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:53.617798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c1293529-f283-4c72-9909-07a9ff09b4c6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:53.627479 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c1293529-f283-4c72-9909-07a9ff09b4c6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1555 microversion: 2.1 time: 0.355146 May 28 14:31:53.636914 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 583/1152] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:53 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1555 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:53.945189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a894fd4b-20e5-46f5-855c-4c7c90d65ed6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:53.946287 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a894fd4b-20e5-46f5-855c-4c7c90d65ed6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:53.954735 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a894fd4b-20e5-46f5-855c-4c7c90d65ed6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:53.955298 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a894fd4b-20e5-46f5-855c-4c7c90d65ed6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:53.956193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a894fd4b-20e5-46f5-855c-4c7c90d65ed6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:53.963933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a894fd4b-20e5-46f5-855c-4c7c90d65ed6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:54.054951 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a894fd4b-20e5-46f5-855c-4c7c90d65ed6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.113940 May 28 14:31:54.056439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 570/1153] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:53 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:54.197769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-51265293-e887-4d0d-b164-0a73ffdab139 req-ceed665d-84c8-4be6-aae4-e743966f859c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4", "name": "network-vif-deleted", "tag": "164fd7c8-7a57-4285-93ef-c3fdabceb8be"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:54.199498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:54.199498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:31:54.209192 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-51265293-e887-4d0d-b164-0a73ffdab139 req-ceed665d-84c8-4be6-aae4-e743966f859c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:54.210891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-51265293-e887-4d0d-b164-0a73ffdab139 req-ceed665d-84c8-4be6-aae4-e743966f859c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:54.232087 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-51265293-e887-4d0d-b164-0a73ffdab139 req-ceed665d-84c8-4be6-aae4-e743966f859c service nova] Creating event network-vif-deleted:164fd7c8-7a57-4285-93ef-c3fdabceb8be for instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 on hv-cinder-79128 May 28 14:31:54.236876 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-51265293-e887-4d0d-b164-0a73ffdab139 req-ceed665d-84c8-4be6-aae4-e743966f859c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042920 May 28 14:31:54.238144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 584/1154] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:31:54.645314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:54.646072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:54.654111 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:54.654568 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:54.655346 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:54.655806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:54.728981 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:54.729439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:54.729905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lazy-loading 'fault' on Instance uuid 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:31:55.067728 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-339f02d7-15e9-4685-8114-b6ff6ababd2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:55.073737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-339f02d7-15e9-4685-8114-b6ff6ababd2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:55.077510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-339f02d7-15e9-4685-8114-b6ff6ababd2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:55.077968 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-339f02d7-15e9-4685-8114-b6ff6ababd2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:55.079409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-339f02d7-15e9-4685-8114-b6ff6ababd2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:55.079884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-339f02d7-15e9-4685-8114-b6ff6ababd2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:55.132890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92db5e1dd631441795575b3f891f6baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:31:55.147187 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7757e079-302d-4e55-b770-cb30202ec051 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 200 len: 1349 microversion: 2.1 time: 0.505318 May 28 14:31:55.147973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 571/1155] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:54 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 1349 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:31:55.183420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-339f02d7-15e9-4685-8114-b6ff6ababd2b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.120436 May 28 14:31:55.188021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 585/1156] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:55 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:55.889173 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-8fa5053d-33d0-45d3-9385-c4c6fdf4e65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2477e125-22c2-4367-b28c-0aaf5754b37c", "tag": "e27f7a0e-7e77-4d61-a393-fe4fde4153d5"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:55.890795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:31:55.890795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:31:55.899646 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-8fa5053d-33d0-45d3-9385-c4c6fdf4e65d service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:55.900111 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-8fa5053d-33d0-45d3-9385-c4c6fdf4e65d service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:55.916572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-8fa5053d-33d0-45d3-9385-c4c6fdf4e65d service nova] Creating event network-changed:e27f7a0e-7e77-4d61-a393-fe4fde4153d5 for instance 2477e125-22c2-4367-b28c-0aaf5754b37c on hv-cinder-79128 May 28 14:31:55.921294 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-8fa5053d-33d0-45d3-9385-c4c6fdf4e65d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036111 May 28 14:31:55.922634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 572/1157] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:31:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:31:56.164798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:56.165401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] [instance: 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:56.174635 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:56.175098 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:56.175976 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:56.176427 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:56.196262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-57847e57-faa1-402e-935d-013d1f2c5193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:56.197995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-57847e57-faa1-402e-935d-013d1f2c5193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:56.206747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-57847e57-faa1-402e-935d-013d1f2c5193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:56.207481 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-57847e57-faa1-402e-935d-013d1f2c5193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:56.212244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-57847e57-faa1-402e-935d-013d1f2c5193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:56.212244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-57847e57-faa1-402e-935d-013d1f2c5193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:56.227725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] HTTP exception thrown: Instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 could not be found. May 28 14:31:56.228365 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Returning 404 to user: Instance 0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:31:56.229342 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-23a1d305-3b69-4b18-a6ea-09c705fb9622 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4" status: 404 len: 111 microversion: 2.1 time: 0.068846 May 28 14:31:56.231971 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 586/1158] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:31:56 2021] GET /compute/v2.1/servers/0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:31:56.238022 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-543e7e39-f68d-4d2a-98b9-46f79815ab90 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling method '.version_select at 0x7f2aaed89ee0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:31:56.314430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-57847e57-faa1-402e-935d-013d1f2c5193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.122063 May 28 14:31:56.316133 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 573/1159] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:56 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:56.360063 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-543e7e39-f68d-4d2a-98b9-46f79815ab90 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1563382805" status: 202 len: 0 microversion: 2.1 time: 0.125603 May 28 14:31:56.361147 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 587/1160] 10.222.0.59 () {58 vars in 1272 bytes} [Fri May 28 14:31:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1563382805 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 14:31:57.328752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-76c3dca3-d110-4368-9461-998f11e9595c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:57.329815 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-76c3dca3-d110-4368-9461-998f11e9595c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:57.338486 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-76c3dca3-d110-4368-9461-998f11e9595c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:57.338948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-76c3dca3-d110-4368-9461-998f11e9595c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:57.339780 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-76c3dca3-d110-4368-9461-998f11e9595c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:57.340230 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-76c3dca3-d110-4368-9461-998f11e9595c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:57.471214 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-76c3dca3-d110-4368-9461-998f11e9595c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.148049 May 28 14:31:57.471946 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 574/1161] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:57 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:58.482976 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ea025806-661d-4c52-83e6-fc27c87e84c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:58.483828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ea025806-661d-4c52-83e6-fc27c87e84c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:58.491776 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea025806-661d-4c52-83e6-fc27c87e84c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:58.494289 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea025806-661d-4c52-83e6-fc27c87e84c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:58.495172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea025806-661d-4c52-83e6-fc27c87e84c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:58.495668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea025806-661d-4c52-83e6-fc27c87e84c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:58.592845 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ea025806-661d-4c52-83e6-fc27c87e84c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.114000 May 28 14:31:58.593484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 588/1162] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:58 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:31:59.605717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-921c5ff8-6a9e-4802-ad4d-a208f01fcfd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:31:59.606746 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-921c5ff8-6a9e-4802-ad4d-a208f01fcfd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:31:59.615077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-921c5ff8-6a9e-4802-ad4d-a208f01fcfd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:59.615527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-921c5ff8-6a9e-4802-ad4d-a208f01fcfd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:59.616333 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-921c5ff8-6a9e-4802-ad4d-a208f01fcfd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:59.616767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-921c5ff8-6a9e-4802-ad4d-a208f01fcfd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:59.719681 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-921c5ff8-6a9e-4802-ad4d-a208f01fcfd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.117557 May 28 14:31:59.723525 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 575/1163] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:31:59 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:00.730866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-db3c00f2-cc45-4325-8c56-39a44ebacfe5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:00.732015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-db3c00f2-cc45-4325-8c56-39a44ebacfe5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:00.740136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db3c00f2-cc45-4325-8c56-39a44ebacfe5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:00.740595 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db3c00f2-cc45-4325-8c56-39a44ebacfe5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:00.741386 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db3c00f2-cc45-4325-8c56-39a44ebacfe5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:00.741828 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db3c00f2-cc45-4325-8c56-39a44ebacfe5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:00.845119 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-db3c00f2-cc45-4325-8c56-39a44ebacfe5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.118187 May 28 14:32:00.845895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 589/1164] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:00 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:01.857757 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-91beea85-bbc3-4e5f-b1d4-39da30b35f0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:01.858865 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-91beea85-bbc3-4e5f-b1d4-39da30b35f0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:01.866856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-91beea85-bbc3-4e5f-b1d4-39da30b35f0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:01.867311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-91beea85-bbc3-4e5f-b1d4-39da30b35f0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:01.868129 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-91beea85-bbc3-4e5f-b1d4-39da30b35f0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:01.868574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-91beea85-bbc3-4e5f-b1d4-39da30b35f0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:01.974658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-91beea85-bbc3-4e5f-b1d4-39da30b35f0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28185 microversion: 2.20 time: 0.120824 May 28 14:32:01.975329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 576/1165] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:01 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:02.987231 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e619e542-9da1-4140-8c04-81cb823bf364 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:02.988334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e619e542-9da1-4140-8c04-81cb823bf364 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:02.996215 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e619e542-9da1-4140-8c04-81cb823bf364 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:02.996667 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e619e542-9da1-4140-8c04-81cb823bf364 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:02.997713 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e619e542-9da1-4140-8c04-81cb823bf364 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:02.998184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e619e542-9da1-4140-8c04-81cb823bf364 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:03.097568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e619e542-9da1-4140-8c04-81cb823bf364 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28476 microversion: 2.20 time: 0.114602 May 28 14:32:03.101424 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 590/1166] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:02 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28476 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:04.114601 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f32c05f9-f0bc-4e54-9afc-05db663aa3e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:04.115641 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f32c05f9-f0bc-4e54-9afc-05db663aa3e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:04.124944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f32c05f9-f0bc-4e54-9afc-05db663aa3e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:04.125403 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f32c05f9-f0bc-4e54-9afc-05db663aa3e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:04.126194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f32c05f9-f0bc-4e54-9afc-05db663aa3e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:04.126628 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f32c05f9-f0bc-4e54-9afc-05db663aa3e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:04.234793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f32c05f9-f0bc-4e54-9afc-05db663aa3e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28476 microversion: 2.20 time: 0.124209 May 28 14:32:04.238848 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 577/1167] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:04 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28476 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:05.247688 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2e2fbfe0-114e-4a52-b3f3-258497f6ead5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:05.248730 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2e2fbfe0-114e-4a52-b3f3-258497f6ead5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:05.257815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e2fbfe0-114e-4a52-b3f3-258497f6ead5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:05.258489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e2fbfe0-114e-4a52-b3f3-258497f6ead5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:05.259373 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e2fbfe0-114e-4a52-b3f3-258497f6ead5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:05.260783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e2fbfe0-114e-4a52-b3f3-258497f6ead5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:05.369110 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2e2fbfe0-114e-4a52-b3f3-258497f6ead5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.125623 May 28 14:32:05.373230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 591/1168] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:05 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:06.382164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dffdf3a0-2c9b-4cfa-8924-683f3eeac9b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:06.383217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dffdf3a0-2c9b-4cfa-8924-683f3eeac9b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:06.391860 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dffdf3a0-2c9b-4cfa-8924-683f3eeac9b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:06.392328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dffdf3a0-2c9b-4cfa-8924-683f3eeac9b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:06.393142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dffdf3a0-2c9b-4cfa-8924-683f3eeac9b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:06.393586 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dffdf3a0-2c9b-4cfa-8924-683f3eeac9b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:06.496621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dffdf3a0-2c9b-4cfa-8924-683f3eeac9b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.118345 May 28 14:32:06.498497 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 578/1169] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:06 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:07.509953 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7c914d8e-711f-4b25-8505-1779984d1f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:07.510926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7c914d8e-711f-4b25-8505-1779984d1f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:07.519058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c914d8e-711f-4b25-8505-1779984d1f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:07.519520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c914d8e-711f-4b25-8505-1779984d1f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:07.520344 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c914d8e-711f-4b25-8505-1779984d1f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:07.520788 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7c914d8e-711f-4b25-8505-1779984d1f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:07.642436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7c914d8e-711f-4b25-8505-1779984d1f3c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.136561 May 28 14:32:07.646885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 592/1170] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:07 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:08.667509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1659eac0-aed8-44b8-bad4-59f4e40fe262 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:08.667509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1659eac0-aed8-44b8-bad4-59f4e40fe262 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:08.669254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1659eac0-aed8-44b8-bad4-59f4e40fe262 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:08.669720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1659eac0-aed8-44b8-bad4-59f4e40fe262 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:08.670512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1659eac0-aed8-44b8-bad4-59f4e40fe262 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:08.670955 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1659eac0-aed8-44b8-bad4-59f4e40fe262 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:08.778523 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1659eac0-aed8-44b8-bad4-59f4e40fe262 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.127291 May 28 14:32:08.779503 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 579/1171] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:08 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:09.792893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ca9f726a-f1a7-448e-971d-985a6473cfe3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:09.793863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ca9f726a-f1a7-448e-971d-985a6473cfe3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:09.803622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ca9f726a-f1a7-448e-971d-985a6473cfe3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:09.804369 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ca9f726a-f1a7-448e-971d-985a6473cfe3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:09.805171 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ca9f726a-f1a7-448e-971d-985a6473cfe3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:09.805622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ca9f726a-f1a7-448e-971d-985a6473cfe3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:09.931010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ca9f726a-f1a7-448e-971d-985a6473cfe3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.142967 May 28 14:32:09.931768 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 593/1172] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:09 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:10.944072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-17c3095e-8011-44cb-9c8e-a43c78ea6c6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:10.945033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-17c3095e-8011-44cb-9c8e-a43c78ea6c6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:10.952892 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-17c3095e-8011-44cb-9c8e-a43c78ea6c6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:10.953958 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-17c3095e-8011-44cb-9c8e-a43c78ea6c6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:10.954264 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-17c3095e-8011-44cb-9c8e-a43c78ea6c6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:10.954729 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-17c3095e-8011-44cb-9c8e-a43c78ea6c6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:11.060708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-17c3095e-8011-44cb-9c8e-a43c78ea6c6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.120816 May 28 14:32:11.061440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 580/1173] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:10 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:12.074339 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f1e0726d-bf42-4bb3-ad3d-83d6e0f1ce48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:12.075333 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f1e0726d-bf42-4bb3-ad3d-83d6e0f1ce48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:12.083918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f1e0726d-bf42-4bb3-ad3d-83d6e0f1ce48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:12.084372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f1e0726d-bf42-4bb3-ad3d-83d6e0f1ce48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:12.085146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f1e0726d-bf42-4bb3-ad3d-83d6e0f1ce48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:12.085587 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f1e0726d-bf42-4bb3-ad3d-83d6e0f1ce48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:12.201808 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f1e0726d-bf42-4bb3-ad3d-83d6e0f1ce48 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.131455 May 28 14:32:12.203033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 594/1174] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:12 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:13.215342 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e4b21054-33d7-4aea-8421-61f18e995806 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:13.216372 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e4b21054-33d7-4aea-8421-61f18e995806 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:13.224777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e4b21054-33d7-4aea-8421-61f18e995806 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:13.225234 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e4b21054-33d7-4aea-8421-61f18e995806 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:13.226004 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e4b21054-33d7-4aea-8421-61f18e995806 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:13.226444 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e4b21054-33d7-4aea-8421-61f18e995806 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:13.331620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e4b21054-33d7-4aea-8421-61f18e995806 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.120307 May 28 14:32:13.332254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 581/1175] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:13 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:32:14.343598 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ebb8b47c-2872-4668-9223-45010c56cc69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:14.344614 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ebb8b47c-2872-4668-9223-45010c56cc69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:14.352507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ebb8b47c-2872-4668-9223-45010c56cc69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:14.352974 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ebb8b47c-2872-4668-9223-45010c56cc69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:14.353761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ebb8b47c-2872-4668-9223-45010c56cc69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:14.354210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ebb8b47c-2872-4668-9223-45010c56cc69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:14.451517 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ebb8b47c-2872-4668-9223-45010c56cc69 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.112071 May 28 14:32:14.452805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 595/1176] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:14 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:15.464757 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-69553986-50b9-4fb3-800c-e545cca78afd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:15.465823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-69553986-50b9-4fb3-800c-e545cca78afd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:15.474589 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-69553986-50b9-4fb3-800c-e545cca78afd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:15.475105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-69553986-50b9-4fb3-800c-e545cca78afd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:15.475926 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-69553986-50b9-4fb3-800c-e545cca78afd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:15.476375 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-69553986-50b9-4fb3-800c-e545cca78afd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:15.576136 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-69553986-50b9-4fb3-800c-e545cca78afd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.115516 May 28 14:32:15.577315 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 582/1177] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:15 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:16.589054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-16b3011c-2dad-4dee-bc9e-13cf75babb4c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:16.590047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-16b3011c-2dad-4dee-bc9e-13cf75babb4c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:16.598541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16b3011c-2dad-4dee-bc9e-13cf75babb4c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:16.608630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16b3011c-2dad-4dee-bc9e-13cf75babb4c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:16.608630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16b3011c-2dad-4dee-bc9e-13cf75babb4c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:16.608630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16b3011c-2dad-4dee-bc9e-13cf75babb4c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:16.695544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-16b3011c-2dad-4dee-bc9e-13cf75babb4c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.110472 May 28 14:32:16.696275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 596/1178] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:16 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:17.708620 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-50dddf13-0181-4ac8-b677-6311cf7a97ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:17.709624 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-50dddf13-0181-4ac8-b677-6311cf7a97ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:17.719500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50dddf13-0181-4ac8-b677-6311cf7a97ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:17.719977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50dddf13-0181-4ac8-b677-6311cf7a97ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:17.720759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50dddf13-0181-4ac8-b677-6311cf7a97ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:17.721196 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-50dddf13-0181-4ac8-b677-6311cf7a97ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:17.823128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-50dddf13-0181-4ac8-b677-6311cf7a97ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.118600 May 28 14:32:17.823837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 583/1179] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:17 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:18.835215 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c930743c-670c-46b5-b945-b837ca503263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:18.836260 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c930743c-670c-46b5-b945-b837ca503263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:18.844288 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c930743c-670c-46b5-b945-b837ca503263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:18.844744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c930743c-670c-46b5-b945-b837ca503263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:18.845538 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c930743c-670c-46b5-b945-b837ca503263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:18.845985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c930743c-670c-46b5-b945-b837ca503263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:18.957327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c930743c-670c-46b5-b945-b837ca503263 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.125916 May 28 14:32:18.958028 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 597/1180] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:18 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:19.970514 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-73f9d791-c6ec-48bc-8e36-a290fbde698e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:19.971525 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-73f9d791-c6ec-48bc-8e36-a290fbde698e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:19.979579 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73f9d791-c6ec-48bc-8e36-a290fbde698e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:19.980055 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73f9d791-c6ec-48bc-8e36-a290fbde698e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:19.980845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73f9d791-c6ec-48bc-8e36-a290fbde698e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:19.981291 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-73f9d791-c6ec-48bc-8e36-a290fbde698e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:20.083379 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-73f9d791-c6ec-48bc-8e36-a290fbde698e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.117458 May 28 14:32:20.084168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 584/1181] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:19 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:21.096750 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dfde1db6-bda5-4016-abb4-044ad8fc2e96 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:21.097692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-dfde1db6-bda5-4016-abb4-044ad8fc2e96 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:21.105826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfde1db6-bda5-4016-abb4-044ad8fc2e96 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:21.106283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfde1db6-bda5-4016-abb4-044ad8fc2e96 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:21.107075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfde1db6-bda5-4016-abb4-044ad8fc2e96 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:21.107519 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfde1db6-bda5-4016-abb4-044ad8fc2e96 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:21.216615 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-dfde1db6-bda5-4016-abb4-044ad8fc2e96 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.124498 May 28 14:32:21.217774 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 598/1182] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:21 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:22.229355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2dd1c08c-8e9d-4820-a349-5d576d522f95 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:22.230390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2dd1c08c-8e9d-4820-a349-5d576d522f95 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:22.238939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2dd1c08c-8e9d-4820-a349-5d576d522f95 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:22.239395 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2dd1c08c-8e9d-4820-a349-5d576d522f95 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:22.240210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2dd1c08c-8e9d-4820-a349-5d576d522f95 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:22.240763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2dd1c08c-8e9d-4820-a349-5d576d522f95 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:22.348979 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2dd1c08c-8e9d-4820-a349-5d576d522f95 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.123671 May 28 14:32:22.349626 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 585/1183] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:22 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:23.361458 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-002ab3d6-e8ad-4201-aa15-ae4f195ff793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:23.362464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-002ab3d6-e8ad-4201-aa15-ae4f195ff793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:23.370426 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-002ab3d6-e8ad-4201-aa15-ae4f195ff793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:23.370883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-002ab3d6-e8ad-4201-aa15-ae4f195ff793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:23.371701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-002ab3d6-e8ad-4201-aa15-ae4f195ff793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:23.372403 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-002ab3d6-e8ad-4201-aa15-ae4f195ff793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:23.484571 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-002ab3d6-e8ad-4201-aa15-ae4f195ff793 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.127783 May 28 14:32:23.485214 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 599/1184] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:23 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:24.497614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c647fbf0-84f4-49f1-977e-c46e89907f80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:24.498653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c647fbf0-84f4-49f1-977e-c46e89907f80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:24.506563 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c647fbf0-84f4-49f1-977e-c46e89907f80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:24.507017 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c647fbf0-84f4-49f1-977e-c46e89907f80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:24.507825 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c647fbf0-84f4-49f1-977e-c46e89907f80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:24.508268 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c647fbf0-84f4-49f1-977e-c46e89907f80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:24.608881 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c647fbf0-84f4-49f1-977e-c46e89907f80 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.115531 May 28 14:32:24.609517 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 586/1185] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:24 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:25.621155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7f740a6d-2578-4ced-ba19-d70d880ea807 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:25.622435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7f740a6d-2578-4ced-ba19-d70d880ea807 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:25.630778 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f740a6d-2578-4ced-ba19-d70d880ea807 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:25.631238 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f740a6d-2578-4ced-ba19-d70d880ea807 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:25.632054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f740a6d-2578-4ced-ba19-d70d880ea807 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:25.632511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f740a6d-2578-4ced-ba19-d70d880ea807 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:25.728806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7f740a6d-2578-4ced-ba19-d70d880ea807 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.111633 May 28 14:32:25.729487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 600/1186] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:25 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:32:26.741261 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-933005cb-50aa-442e-9080-73e3f4149d92 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:26.742268 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-933005cb-50aa-442e-9080-73e3f4149d92 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:26.751170 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-933005cb-50aa-442e-9080-73e3f4149d92 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:26.751651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-933005cb-50aa-442e-9080-73e3f4149d92 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:26.752442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-933005cb-50aa-442e-9080-73e3f4149d92 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:26.752883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-933005cb-50aa-442e-9080-73e3f4149d92 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:26.849194 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-933005cb-50aa-442e-9080-73e3f4149d92 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.112078 May 28 14:32:26.849900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 587/1187] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:26 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 28 14:32:27.862400 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-94ab7183-0952-482b-a5b4-0b0c299a945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:27.863459 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-94ab7183-0952-482b-a5b4-0b0c299a945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:27.871062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-94ab7183-0952-482b-a5b4-0b0c299a945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:27.873341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-94ab7183-0952-482b-a5b4-0b0c299a945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:27.873341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-94ab7183-0952-482b-a5b4-0b0c299a945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:27.873341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-94ab7183-0952-482b-a5b4-0b0c299a945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:27.966502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-94ab7183-0952-482b-a5b4-0b0c299a945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.108763 May 28 14:32:27.967705 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 601/1188] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:27 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:28.978962 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e77cffca-c0dd-4cf6-aa7e-9dbae0f723bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:28.979994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e77cffca-c0dd-4cf6-aa7e-9dbae0f723bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:28.987890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e77cffca-c0dd-4cf6-aa7e-9dbae0f723bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:28.988341 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e77cffca-c0dd-4cf6-aa7e-9dbae0f723bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:28.989110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e77cffca-c0dd-4cf6-aa7e-9dbae0f723bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:28.989545 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e77cffca-c0dd-4cf6-aa7e-9dbae0f723bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:29.093462 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e77cffca-c0dd-4cf6-aa7e-9dbae0f723bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.118449 May 28 14:32:29.094101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 588/1189] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:28 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:30.105907 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7666cb8c-6169-4b88-807e-f04cb38a61da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:30.106819 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7666cb8c-6169-4b88-807e-f04cb38a61da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:30.114655 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7666cb8c-6169-4b88-807e-f04cb38a61da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:30.115103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7666cb8c-6169-4b88-807e-f04cb38a61da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:30.115912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7666cb8c-6169-4b88-807e-f04cb38a61da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:30.116349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7666cb8c-6169-4b88-807e-f04cb38a61da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:30.210961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7666cb8c-6169-4b88-807e-f04cb38a61da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.109248 May 28 14:32:30.213558 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 602/1190] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:30 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:31.223488 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-304e6b99-1d88-4a44-8e75-cdcd26085b60 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:31.224515 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-304e6b99-1d88-4a44-8e75-cdcd26085b60 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:31.233097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-304e6b99-1d88-4a44-8e75-cdcd26085b60 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:31.233549 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-304e6b99-1d88-4a44-8e75-cdcd26085b60 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:31.234327 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-304e6b99-1d88-4a44-8e75-cdcd26085b60 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:31.234793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-304e6b99-1d88-4a44-8e75-cdcd26085b60 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:31.329476 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-304e6b99-1d88-4a44-8e75-cdcd26085b60 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.110164 May 28 14:32:31.330023 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 589/1191] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:31 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:32.341911 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a0102e72-4d05-4182-9c2d-1a1297463db0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:32.342910 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a0102e72-4d05-4182-9c2d-1a1297463db0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:32.350838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a0102e72-4d05-4182-9c2d-1a1297463db0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:32.354821 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a0102e72-4d05-4182-9c2d-1a1297463db0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:32.354821 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a0102e72-4d05-4182-9c2d-1a1297463db0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:32.354821 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a0102e72-4d05-4182-9c2d-1a1297463db0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:32.448103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a0102e72-4d05-4182-9c2d-1a1297463db0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.110143 May 28 14:32:32.449036 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 603/1192] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:32 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:33.462025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e27e590a-b6d4-4149-8f90-1d66d89b90a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:33.463039 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e27e590a-b6d4-4149-8f90-1d66d89b90a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:33.472056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e27e590a-b6d4-4149-8f90-1d66d89b90a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:33.472516 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e27e590a-b6d4-4149-8f90-1d66d89b90a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:33.473300 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e27e590a-b6d4-4149-8f90-1d66d89b90a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:33.473764 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e27e590a-b6d4-4149-8f90-1d66d89b90a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:33.570574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e27e590a-b6d4-4149-8f90-1d66d89b90a5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.112600 May 28 14:32:33.574493 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 590/1193] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:33 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:34.583454 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-15ebc5df-3472-42e3-b560-2d9261d9f68d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:34.584396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-15ebc5df-3472-42e3-b560-2d9261d9f68d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:34.592247 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-15ebc5df-3472-42e3-b560-2d9261d9f68d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:34.592699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-15ebc5df-3472-42e3-b560-2d9261d9f68d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:34.593474 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-15ebc5df-3472-42e3-b560-2d9261d9f68d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:34.593912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-15ebc5df-3472-42e3-b560-2d9261d9f68d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:34.699176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-15ebc5df-3472-42e3-b560-2d9261d9f68d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.119853 May 28 14:32:34.700087 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 604/1194] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:34 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:35.711811 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6506044d-7cbc-492d-95ee-af86428e4b6c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:35.712845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6506044d-7cbc-492d-95ee-af86428e4b6c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:35.721158 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6506044d-7cbc-492d-95ee-af86428e4b6c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:35.721605 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6506044d-7cbc-492d-95ee-af86428e4b6c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:35.722420 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6506044d-7cbc-492d-95ee-af86428e4b6c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:35.722848 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6506044d-7cbc-492d-95ee-af86428e4b6c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:35.822316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6506044d-7cbc-492d-95ee-af86428e4b6c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.114593 May 28 14:32:35.823250 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 591/1195] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:35 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:36.834572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3a6adc13-290c-4db9-9b39-ae6295e015bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:36.835620 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3a6adc13-290c-4db9-9b39-ae6295e015bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:36.843565 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a6adc13-290c-4db9-9b39-ae6295e015bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:36.844049 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a6adc13-290c-4db9-9b39-ae6295e015bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:36.844841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a6adc13-290c-4db9-9b39-ae6295e015bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:36.845292 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3a6adc13-290c-4db9-9b39-ae6295e015bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:36.939754 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3a6adc13-290c-4db9-9b39-ae6295e015bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.109151 May 28 14:32:36.940413 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 605/1196] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:36 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:37.952765 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a5576e59-3f81-45ad-ade0-fa8b5e17c601 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:37.953777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a5576e59-3f81-45ad-ade0-fa8b5e17c601 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:37.961731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5576e59-3f81-45ad-ade0-fa8b5e17c601 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:37.962180 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5576e59-3f81-45ad-ade0-fa8b5e17c601 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:37.962950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5576e59-3f81-45ad-ade0-fa8b5e17c601 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:37.963385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5576e59-3f81-45ad-ade0-fa8b5e17c601 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:38.064045 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a5576e59-3f81-45ad-ade0-fa8b5e17c601 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.115913 May 28 14:32:38.064731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 592/1197] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:37 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:39.095701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2c9bf2aa-0d37-4735-bbbd-08a2037e7f15 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:39.095701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2c9bf2aa-0d37-4735-bbbd-08a2037e7f15 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:39.103226 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2c9bf2aa-0d37-4735-bbbd-08a2037e7f15 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:39.103734 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2c9bf2aa-0d37-4735-bbbd-08a2037e7f15 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:39.104529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2c9bf2aa-0d37-4735-bbbd-08a2037e7f15 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:39.104977 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2c9bf2aa-0d37-4735-bbbd-08a2037e7f15 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:39.206916 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2c9bf2aa-0d37-4735-bbbd-08a2037e7f15 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.117398 May 28 14:32:39.208812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 606/1198] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:39 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:40.219065 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a63d6932-6d36-489c-86d2-208b609c655b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:40.220088 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a63d6932-6d36-489c-86d2-208b609c655b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:40.227932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a63d6932-6d36-489c-86d2-208b609c655b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:40.228423 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a63d6932-6d36-489c-86d2-208b609c655b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:40.229187 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a63d6932-6d36-489c-86d2-208b609c655b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:40.229618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a63d6932-6d36-489c-86d2-208b609c655b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:40.330707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a63d6932-6d36-489c-86d2-208b609c655b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 28644 microversion: 2.20 time: 0.115769 May 28 14:32:40.331345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 593/1199] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:40 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 28644 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:41.342462 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-30495dac-b313-419c-a03e-dba2804a1a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:41.343378 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-30495dac-b313-419c-a03e-dba2804a1a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:41.351313 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30495dac-b313-419c-a03e-dba2804a1a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:41.351805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30495dac-b313-419c-a03e-dba2804a1a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:41.352584 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30495dac-b313-419c-a03e-dba2804a1a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:41.353045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30495dac-b313-419c-a03e-dba2804a1a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:41.457176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-30495dac-b313-419c-a03e-dba2804a1a41 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 29021 microversion: 2.20 time: 0.118752 May 28 14:32:41.457826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 607/1200] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:41 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 29021 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:42.469821 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-604fc22e-b428-4a94-832a-cd2ad6698224 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:42.470813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-604fc22e-b428-4a94-832a-cd2ad6698224 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:42.479111 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-604fc22e-b428-4a94-832a-cd2ad6698224 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:42.479581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-604fc22e-b428-4a94-832a-cd2ad6698224 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:42.480598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-604fc22e-b428-4a94-832a-cd2ad6698224 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:42.480859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-604fc22e-b428-4a94-832a-cd2ad6698224 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:42.576832 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-604fc22e-b428-4a94-832a-cd2ad6698224 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 31059 microversion: 2.20 time: 0.111015 May 28 14:32:42.577481 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 594/1201] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:42 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 31059 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:43.589358 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-84f32570-ad5f-4a38-8617-44b9f85fd7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:43.590402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-84f32570-ad5f-4a38-8617-44b9f85fd7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:43.598925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-84f32570-ad5f-4a38-8617-44b9f85fd7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:43.599388 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-84f32570-ad5f-4a38-8617-44b9f85fd7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:43.600216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-84f32570-ad5f-4a38-8617-44b9f85fd7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:43.600664 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-84f32570-ad5f-4a38-8617-44b9f85fd7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:43.699297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-84f32570-ad5f-4a38-8617-44b9f85fd7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 32430 microversion: 2.20 time: 0.114057 May 28 14:32:43.700609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 608/1202] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:43 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 32430 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:44.712664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-72516b88-172a-499f-be54-79aab3b6e341 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:44.713682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-72516b88-172a-499f-be54-79aab3b6e341 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:44.722848 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-72516b88-172a-499f-be54-79aab3b6e341 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:44.723310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-72516b88-172a-499f-be54-79aab3b6e341 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:44.724147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-72516b88-172a-499f-be54-79aab3b6e341 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:44.724595 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-72516b88-172a-499f-be54-79aab3b6e341 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:44.843025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-72516b88-172a-499f-be54-79aab3b6e341 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 33413 microversion: 2.20 time: 0.134411 May 28 14:32:44.843823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 595/1203] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:44 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 33413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:45.856631 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-890ddf83-37b6-47fa-97e6-32375d3e5ff0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:45.857653 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-890ddf83-37b6-47fa-97e6-32375d3e5ff0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:45.865657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-890ddf83-37b6-47fa-97e6-32375d3e5ff0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:45.866113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-890ddf83-37b6-47fa-97e6-32375d3e5ff0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:45.866896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-890ddf83-37b6-47fa-97e6-32375d3e5ff0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:45.867339 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-890ddf83-37b6-47fa-97e6-32375d3e5ff0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:45.974058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-890ddf83-37b6-47fa-97e6-32375d3e5ff0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 34424 microversion: 2.20 time: 0.122211 May 28 14:32:45.974699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 609/1204] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:45 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 34424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:46.986746 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f86f405d-00aa-45e6-8aed-12f1885edd78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:46.987773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f86f405d-00aa-45e6-8aed-12f1885edd78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:46.995994 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f86f405d-00aa-45e6-8aed-12f1885edd78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:46.996747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f86f405d-00aa-45e6-8aed-12f1885edd78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:46.997528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f86f405d-00aa-45e6-8aed-12f1885edd78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:46.997963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f86f405d-00aa-45e6-8aed-12f1885edd78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:47.101496 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f86f405d-00aa-45e6-8aed-12f1885edd78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 35601 microversion: 2.20 time: 0.118843 May 28 14:32:47.102154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 596/1205] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:46 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 35601 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:48.114181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ec2bda23-97b7-4631-a6ff-aa69ed8b7526 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:48.115138 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ec2bda23-97b7-4631-a6ff-aa69ed8b7526 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:48.123704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec2bda23-97b7-4631-a6ff-aa69ed8b7526 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:48.129662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec2bda23-97b7-4631-a6ff-aa69ed8b7526 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:48.129662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec2bda23-97b7-4631-a6ff-aa69ed8b7526 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:48.129662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ec2bda23-97b7-4631-a6ff-aa69ed8b7526 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:48.234925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ec2bda23-97b7-4631-a6ff-aa69ed8b7526 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 37012 microversion: 2.20 time: 0.124800 May 28 14:32:48.235708 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 610/1206] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:48 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 37012 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:49.248166 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9afad0b9-9694-4c9d-bbea-80f0397ada1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:49.249156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9afad0b9-9694-4c9d-bbea-80f0397ada1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:49.256964 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9afad0b9-9694-4c9d-bbea-80f0397ada1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:49.257414 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9afad0b9-9694-4c9d-bbea-80f0397ada1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:49.258355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9afad0b9-9694-4c9d-bbea-80f0397ada1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:49.258706 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9afad0b9-9694-4c9d-bbea-80f0397ada1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:49.357292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9afad0b9-9694-4c9d-bbea-80f0397ada1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 38192 microversion: 2.20 time: 0.113113 May 28 14:32:49.358145 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 597/1207] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:49 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 38192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:50.369418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-07cb0f75-50a7-4f4b-9c28-5fc8992b4fd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:50.370431 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-07cb0f75-50a7-4f4b-9c28-5fc8992b4fd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:50.378849 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07cb0f75-50a7-4f4b-9c28-5fc8992b4fd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:50.379371 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07cb0f75-50a7-4f4b-9c28-5fc8992b4fd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:50.380189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07cb0f75-50a7-4f4b-9c28-5fc8992b4fd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:50.380637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07cb0f75-50a7-4f4b-9c28-5fc8992b4fd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:50.481734 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-07cb0f75-50a7-4f4b-9c28-5fc8992b4fd6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 38192 microversion: 2.20 time: 0.116328 May 28 14:32:50.482709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 611/1208] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:50 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 38192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:51.494446 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a93b538b-1476-4efc-bf51-908409ab3eaa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:51.495449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a93b538b-1476-4efc-bf51-908409ab3eaa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:51.504861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a93b538b-1476-4efc-bf51-908409ab3eaa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:51.511923 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a93b538b-1476-4efc-bf51-908409ab3eaa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:51.511923 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a93b538b-1476-4efc-bf51-908409ab3eaa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:51.511923 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a93b538b-1476-4efc-bf51-908409ab3eaa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:51.608699 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a93b538b-1476-4efc-bf51-908409ab3eaa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 38192 microversion: 2.20 time: 0.118280 May 28 14:32:51.609661 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 598/1209] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:51 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 38192 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:52.621745 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a3679d75-bb4d-43e5-9d37-e79c7dc484da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:52.622784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a3679d75-bb4d-43e5-9d37-e79c7dc484da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:52.631000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a3679d75-bb4d-43e5-9d37-e79c7dc484da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:52.631458 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a3679d75-bb4d-43e5-9d37-e79c7dc484da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:52.632306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a3679d75-bb4d-43e5-9d37-e79c7dc484da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:52.632754 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a3679d75-bb4d-43e5-9d37-e79c7dc484da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:52.738061 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a3679d75-bb4d-43e5-9d37-e79c7dc484da tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 38192 microversion: 2.20 time: 0.120795 May 28 14:32:52.738720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 612/1210] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:52 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 38192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:53.751095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-53d132c7-7666-4a03-932e-0de30caac855 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:53.752187 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-53d132c7-7666-4a03-932e-0de30caac855 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:53.760204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-53d132c7-7666-4a03-932e-0de30caac855 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:53.760665 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-53d132c7-7666-4a03-932e-0de30caac855 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:53.761527 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-53d132c7-7666-4a03-932e-0de30caac855 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:53.761973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-53d132c7-7666-4a03-932e-0de30caac855 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:53.872851 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-53d132c7-7666-4a03-932e-0de30caac855 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 200 len: 38332 microversion: 2.20 time: 0.126475 May 28 14:32:53.873781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 599/1211] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:53 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 38332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 14:32:53.883916 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cc894345-cef7-4846-8c78-8298ada44c7d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:32:53.884500 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cc894345-cef7-4846-8c78-8298ada44c7d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:53.892328 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cc894345-cef7-4846-8c78-8298ada44c7d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:53.892784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cc894345-cef7-4846-8c78-8298ada44c7d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:53.893555 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cc894345-cef7-4846-8c78-8298ada44c7d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:53.893993 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cc894345-cef7-4846-8c78-8298ada44c7d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:53.952809 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cc894345-cef7-4846-8c78-8298ada44c7d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/ips" status: 200 len: 152 microversion: 2.20 time: 0.073130 May 28 14:32:53.953382 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 613/1212] 10.222.0.59 () {60 vars in 1289 bytes} [Fri May 28 14:32:53 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/ips => generated 152 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:32:57.850202 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bfafcb98-faca-4088-af1e-122f9ae7a713 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:32:57.850820 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bfafcb98-faca-4088-af1e-122f9ae7a713 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:57.859269 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfafcb98-faca-4088-af1e-122f9ae7a713 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:57.859766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfafcb98-faca-4088-af1e-122f9ae7a713 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:57.860540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfafcb98-faca-4088-af1e-122f9ae7a713 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:57.861104 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bfafcb98-faca-4088-af1e-122f9ae7a713 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:57.916815 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-bfafcb98-faca-4088-af1e-122f9ae7a713 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lazy-loading 'flavor' on Instance uuid d654fce7-a7f9-4505-bb9a-de526002e464 {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:32:58.621525 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bfafcb98-faca-4088-af1e-122f9ae7a713 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 202 len: 0 microversion: 2.20 time: 0.775176 May 28 14:32:58.622156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 600/1213] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:32:57 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 14:32:58.630213 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:32:58.630872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:58.639071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:58.639533 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:58.640354 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:58.640801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:58.840708 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:32:58.849376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:32:58.850907 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:32:58.852098 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-416a2067-4755-48e1-8b2d-51cc568d038a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.225716 May 28 14:32:58.852662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 614/1214] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:32:58 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:32:59.871492 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:32:59.872326 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:32:59.880018 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:59.880478 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:59.881254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:59.881695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:00.079639 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:00.088616 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:00.090659 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:00.091832 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6ad73606-1d02-4b3b-ae9e-5781222f58ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.225281 May 28 14:33:00.092393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 601/1215] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:32:59 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:01.109613 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:01.110240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:01.118101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:01.118561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:01.119406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:01.119887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:01.312700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:01.321354 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:01.322875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:01.324659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f9fb0776-68e3-45ca-9043-2809233014b2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.218291 May 28 14:33:01.325225 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 615/1216] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:01 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:02.343831 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:02.344381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:02.352110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:02.352564 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:02.353334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:02.353769 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:02.546490 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:02.555192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:02.556747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:02.557908 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dd962751-5552-404c-b3c4-fa3c64538bc6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.218786 May 28 14:33:02.558449 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 602/1217] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:02 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:03.576853 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:03.577499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:03.585067 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:03.585723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:03.586610 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:03.587084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:03.792659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:03.801578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:03.803129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:03.804291 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7a67055c-dfdd-4352-8201-bd26eb66f496 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.232047 May 28 14:33:03.804887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 616/1218] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:03 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:04.822192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:04.822809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:04.830176 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:04.830629 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:04.831400 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:04.831878 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:05.122641 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:05.131805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:05.133358 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:05.134509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.316170 May 28 14:33:05.135075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 603/1219] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:04 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:06.160456 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:06.160456 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:06.168236 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:06.168699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:06.169489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:06.169955 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:06.361555 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:06.370182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:06.372015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:06.373164 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-637dc818-4736-48d8-8a8e-49c06fa98969 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.218150 May 28 14:33:06.373724 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 617/1220] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:06 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:07.391960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:07.392494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:07.400181 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:07.400635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:07.401427 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:07.401864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:07.596220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:07.605292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:07.606846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:07.608011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.219838 May 28 14:33:07.608565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 604/1221] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:07 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:08.625823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:08.626455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:08.634427 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:08.637335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:08.637335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:08.637335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:08.844370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:08.853607 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:08.855218 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:08.856451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cd7beaca-f735-4cf8-b138-14911bb6b7dd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.234522 May 28 14:33:08.857112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 618/1222] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:08 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:09.875500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:09.876135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:09.883396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:09.883884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:09.884654 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:09.885117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:10.075690 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:10.084335 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:10.085864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:10.086995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.215739 May 28 14:33:10.087609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 605/1223] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:09 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:11.106280 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:11.106899 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:11.114200 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:11.114658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:11.115434 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:11.115908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:11.313874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:11.322556 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:11.324113 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:11.325271 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5ff1eb21-20cc-48ef-b5ff-968778b873ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.223464 May 28 14:33:11.325823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 619/1224] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:11 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:12.343191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:12.343846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:12.351038 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:12.351492 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:12.352295 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:12.352733 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:12.551978 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:12.561682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:12.565257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:12.565257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.225541 May 28 14:33:12.565257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 606/1225] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:12 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:13.583128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:13.583804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:13.591069 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:13.591530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:13.592350 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:13.592798 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:13.785784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:13.795534 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:13.797096 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:13.798240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.218905 May 28 14:33:13.798825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 620/1226] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:13 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:14.818651 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:14.819271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:14.827440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:14.827944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:14.828722 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:14.829183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:15.022217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:15.030942 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:15.032530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:15.033673 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c27f9dd2-3d9c-4b90-accb-9c3033344277 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.219996 May 28 14:33:15.034228 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 607/1227] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:14 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:16.052098 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:16.052710 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:16.061155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:16.061608 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:16.062386 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:16.062820 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:16.262348 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:16.271078 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:16.272630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:16.273807 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-af360292-7cc6-46c1-ab0f-35961d49ada7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1743 microversion: 2.20 time: 0.225492 May 28 14:33:16.274374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 621/1228] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:16 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:17.292813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:17.293415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:17.301182 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:17.301641 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:17.302418 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:17.302861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:17.498706 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:17.507342 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:17.508889 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:17.510005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a0602c5b-676b-4d3c-870e-7718f9e476e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1743 microversion: 2.20 time: 0.221037 May 28 14:33:17.510565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 608/1229] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:17 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1743 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:18.168455 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-220f7771-23e7-42de-b4d8-c478435e7c65 req-1c597f45-9d7c-4958-b236-c17b235640dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d654fce7-a7f9-4505-bb9a-de526002e464", "name": "network-vif-plugged", "status": "completed", "tag": "65e6ef94-43dd-499b-b9bb-2e42a8536b59"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:33:18.170047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:33:18.170047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:33:18.178169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-220f7771-23e7-42de-b4d8-c478435e7c65 req-1c597f45-9d7c-4958-b236-c17b235640dd service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:18.178625 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-220f7771-23e7-42de-b4d8-c478435e7c65 req-1c597f45-9d7c-4958-b236-c17b235640dd service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:18.194595 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-220f7771-23e7-42de-b4d8-c478435e7c65 req-1c597f45-9d7c-4958-b236-c17b235640dd service nova] Creating event network-vif-plugged:65e6ef94-43dd-499b-b9bb-2e42a8536b59 for instance d654fce7-a7f9-4505-bb9a-de526002e464 on hv-cinder-79128 May 28 14:33:18.199995 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-220f7771-23e7-42de-b4d8-c478435e7c65 req-1c597f45-9d7c-4958-b236-c17b235640dd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226998 May 28 14:33:18.200597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 622/1230] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:33:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:33:18.528076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:18.528691 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:18.536059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:18.536530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:18.537313 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:18.537759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:18.734758 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:18.743713 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:18.745777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:18.747189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-288068ab-5849-496a-8f0b-e6ac3675d096 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1743 microversion: 2.20 time: 0.222962 May 28 14:33:18.747791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 609/1231] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:18 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1743 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:19.767118 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:19.767909 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:19.775525 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:19.776652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:19.777439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:19.777888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:19.975078 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:19.983792 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:19.985318 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:19.986447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c54f337a-af8c-4c94-8aec-2a297f437d26 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1743 microversion: 2.20 time: 0.223646 May 28 14:33:19.986992 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 623/1232] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:19 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:21.005200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:21.005819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:21.013086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:21.013547 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:21.014330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:21.014775 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:21.208659 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:21.218445 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:21.220204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:21.221403 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-158d8adb-5d6b-4f4b-8405-199b2d1de383 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1743 microversion: 2.20 time: 0.219982 May 28 14:33:21.221975 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 610/1233] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:21 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:22.239015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:22.239743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:22.248057 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:22.248519 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:22.249343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:22.249803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:22.536993 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:22.546155 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:22.547709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:22.549114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8ca8f31e-0ce1-492a-ab91-946acb93040d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.314144 May 28 14:33:22.549678 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 624/1234] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:22 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:23.568363 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:23.569670 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:23.577670 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:23.578135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:23.578935 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:23.579389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:23.781630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:23.791716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:23.793350 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:23.794489 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c69d8a6f-204e-40fe-88e1-8c299741a670 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.230011 May 28 14:33:23.795078 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 611/1235] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:23 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:24.812577 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:24.813327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:24.820822 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:24.821287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:24.822818 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:24.823781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:25.036890 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:25.047274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:25.049370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:25.052980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-943ed18b-1701-4bd1-b43f-ce4e590b3408 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.242014 May 28 14:33:25.052980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 625/1236] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:24 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:33:26.070350 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:26.070886 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:26.079502 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:26.079995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:26.080795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:26.081239 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:26.295901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:26.304494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:26.306011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:26.307689 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dbc36d53-894f-4542-84c3-76853c8a5f81 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.241249 May 28 14:33:26.308258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 612/1237] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:26 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:27.326844 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:27.327663 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:27.335898 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:27.336388 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:27.337253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:27.337752 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:27.550515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:27.563129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:27.565484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:27.566723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.244652 May 28 14:33:27.579230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 626/1238] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:27 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:28.586204 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:28.587597 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:28.595456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:28.596274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:28.597318 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:28.597968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:28.819006 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:28.828293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:28.829890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:28.831126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b35392e6-59c6-4c43-86ad-304c0925775d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.248627 May 28 14:33:28.841842 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 613/1239] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:28 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:29.848669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:29.849319 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:29.856895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:29.857416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:29.858204 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:29.858646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:30.079685 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:30.093101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:30.094896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:30.096089 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.251362 May 28 14:33:30.097291 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 627/1240] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:29 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:31.114692 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:31.116020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:31.126895 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:31.127681 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:31.128548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:31.129060 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:31.344488 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:31.353900 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:31.355353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:31.356613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bc163216-6c76-44e0-9312-5123eb9b787e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.246285 May 28 14:33:31.357604 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 614/1241] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:31 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:32.377585 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:32.378257 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:32.387435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:32.387908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:32.388837 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:32.389283 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:32.604472 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:32.614079 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:32.615637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:32.617032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bafb91fe-6588-4ddc-b994-6a7dc75966bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.245005 May 28 14:33:32.617612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 628/1242] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:32 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:33.636311 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:33.638479 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:33.647815 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:33.649077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:33.650211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:33.650914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:33.875920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:33.887321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:33.888903 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:33.890042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.257935 May 28 14:33:33.900825 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 615/1243] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:33 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:34.908166 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:34.908826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:34.916133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:34.916595 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:34.917369 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:34.917805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:35.127509 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:35.136942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:35.138479 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:35.139694 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1738 microversion: 2.20 time: 0.235283 May 28 14:33:35.140285 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 629/1244] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:34 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:36.158306 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:36.159066 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:36.167401 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:36.167937 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:36.168737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:36.169180 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:36.368118 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:36.377942 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:36.379453 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:36.380607 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1c870ff6-329d-4c39-983c-4618e0bf3e7b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1720 microversion: 2.20 time: 0.226117 May 28 14:33:36.381168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 616/1245] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:36 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:37.398688 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:37.399307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:37.407016 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:37.407480 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:37.408307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:37.408755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:37.600975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:37.610338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:37.611920 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:37.613071 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5a139b3b-c039-4ac1-809e-5e0019e44c9d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1720 microversion: 2.20 time: 0.218161 May 28 14:33:37.613632 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 630/1246] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:37 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:38.631262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:38.631911 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:38.639249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:38.639771 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:38.640546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:38.640988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:38.837992 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:38.846940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:38.848505 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:38.849643 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-711b7ce0-f870-4620-8626-dfbcdc807a40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1723 microversion: 2.20 time: 0.222152 May 28 14:33:38.850217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 617/1247] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:38 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:38.867469 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ad20af2e-afaa-46ed-9af6-9deac6b60ad0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f48546ef-bd61-4f00-9215-16167012c7de"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:33:38.868592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ad20af2e-afaa-46ed-9af6-9deac6b60ad0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:38.876249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ad20af2e-afaa-46ed-9af6-9deac6b60ad0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:38.877919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ad20af2e-afaa-46ed-9af6-9deac6b60ad0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:38.877919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ad20af2e-afaa-46ed-9af6-9deac6b60ad0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:38.877919 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ad20af2e-afaa-46ed-9af6-9deac6b60ad0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:40.047146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-2bce4b54-4d3e-4115-96fe-3b2e62562d2e req-7c816de4-5c71-4731-8a62-28b47a740fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d654fce7-a7f9-4505-bb9a-de526002e464", "name": "network-vif-unplugged", "status": "completed", "tag": "65e6ef94-43dd-499b-b9bb-2e42a8536b59"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:33:40.048821 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:33:40.048821 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:33:40.057002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-2bce4b54-4d3e-4115-96fe-3b2e62562d2e req-7c816de4-5c71-4731-8a62-28b47a740fe5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:40.058059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-2bce4b54-4d3e-4115-96fe-3b2e62562d2e req-7c816de4-5c71-4731-8a62-28b47a740fe5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:40.074162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.compute.server_external_events [req-2bce4b54-4d3e-4115-96fe-3b2e62562d2e req-7c816de4-5c71-4731-8a62-28b47a740fe5 service nova] Unable to find a host for instance d654fce7-a7f9-4505-bb9a-de526002e464. Dropping event network-vif-unplugged {{(pid=106812) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 28 14:33:40.075094 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-2bce4b54-4d3e-4115-96fe-3b2e62562d2e req-7c816de4-5c71-4731-8a62-28b47a740fe5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034202 May 28 14:33:40.076052 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 618/1248] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:33:40 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 14:33:40.210507 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ad20af2e-afaa-46ed-9af6-9deac6b60ad0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.346788 May 28 14:33:40.211466 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 631/1249] 10.222.0.59 () {62 vars in 1364 bytes} [Fri May 28 14:33:38 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/os-volume_attachments => generated 188 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:33:40.313523 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-37a9c616-4d52-41d2-9e17-969ca97bfc27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:40.314033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-37a9c616-4d52-41d2-9e17-969ca97bfc27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:40.321233 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-37a9c616-4d52-41d2-9e17-969ca97bfc27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:40.321695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-37a9c616-4d52-41d2-9e17-969ca97bfc27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:40.322483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-37a9c616-4d52-41d2-9e17-969ca97bfc27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:40.323482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-37a9c616-4d52-41d2-9e17-969ca97bfc27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:41.118611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-37a9c616-4d52-41d2-9e17-969ca97bfc27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/os-volume_attachments/f48546ef-bd61-4f00-9215-16167012c7de" status: 202 len: 0 microversion: 2.20 time: 0.808803 May 28 14:33:41.119260 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 619/1250] 10.222.0.59 () {60 vars in 1457 bytes} [Fri May 28 14:33:40 2021] DELETE /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/os-volume_attachments/f48546ef-bd61-4f00-9215-16167012c7de => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 14:33:41.216080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7852d83f-1959-462a-9ef0-604edb9a13cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:33:41.216680 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7852d83f-1959-462a-9ef0-604edb9a13cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:41.224133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7852d83f-1959-462a-9ef0-604edb9a13cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:41.224578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7852d83f-1959-462a-9ef0-604edb9a13cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:41.225367 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7852d83f-1959-462a-9ef0-604edb9a13cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:41.225838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7852d83f-1959-462a-9ef0-604edb9a13cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:41.473555 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7852d83f-1959-462a-9ef0-604edb9a13cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action" status: 202 len: 0 microversion: 2.20 time: 0.261827 May 28 14:33:41.477873 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 632/1251] 10.222.0.59 () {62 vars in 1319 bytes} [Fri May 28 14:33:41 2021] POST /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 14:33:41.482147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:41.482791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:41.490667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:41.491122 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:41.491934 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:41.492424 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:41.692955 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:41.701668 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:41.703208 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:41.704361 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-845c9f60-9533-40e0-babd-30f7eca8c891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1671 microversion: 2.20 time: 0.226002 May 28 14:33:41.704931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 620/1252] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:41 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:42.722879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:42.723499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:42.730773 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:42.731234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:42.732121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:42.732563 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:42.928230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:42.937421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:42.938944 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:42.940120 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-552eae83-5d28-407d-9089-86216ec60e6e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1671 microversion: 2.20 time: 0.221066 May 28 14:33:42.940685 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 633/1253] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:42 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:43.957270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:43.957891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:43.965270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:43.965729 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:43.966505 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:43.966945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:44.163098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:44.173497 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:44.175076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:44.176248 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1671 microversion: 2.20 time: 0.222799 May 28 14:33:44.176816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 621/1254] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:43 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:45.194149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:45.194769 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:45.202687 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:45.203180 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:45.203999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:45.204446 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:45.412803 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:45.423835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:45.426902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:45.426902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1671 microversion: 2.20 time: 0.236383 May 28 14:33:45.428851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 634/1255] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:45 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1671 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:33:46.454361 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:46.455364 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:46.462767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:46.463248 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:46.464740 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:46.465185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:46.665314 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:46.674870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:46.676451 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:46.677747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ae7162d3-b147-4781-b022-8fc12f04fdb0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.227561 May 28 14:33:46.678312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 622/1256] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:46 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:47.695469 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:47.696032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:47.704448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:47.704914 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:47.705717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:47.706166 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:47.909531 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:47.918597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:47.920187 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:47.921341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f0970ba3-6322-4eea-a3dd-98e533e03456 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.229766 May 28 14:33:47.921888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 635/1257] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:47 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:48.940650 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:48.941254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:48.949495 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:48.949952 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:48.950848 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:48.951188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:49.250533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:49.262335 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:49.264045 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:49.265353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b52f9a26-6305-49fb-aec9-73843faff165 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.328415 May 28 14:33:49.266404 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 623/1258] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:48 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:50.283797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:50.284417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:50.292421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:50.292886 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:50.293849 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:50.294245 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:50.600432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:50.611295 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:50.612853 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:50.614024 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-00029bbc-0300-4d42-8f34-a6a52ba041fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.334117 May 28 14:33:50.622959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 636/1259] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:50 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:51.632679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:51.633310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:51.641880 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:51.642410 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:51.643306 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:51.643781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:51.878077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:51.888032 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:51.889604 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:51.890816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8867fe2c-7660-418f-8c55-f36df1e1038e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.261944 May 28 14:33:51.892283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 624/1260] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:51 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:33:52.911344 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:52.912083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:52.920682 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:52.921218 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:52.922015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:52.922449 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:53.128649 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:53.138055 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:53.139655 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:53.140810 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c16824e7-b9a5-4df6-82a4-2673009031af tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.233283 May 28 14:33:53.141370 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 637/1261] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:52 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:54.159379 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:54.159975 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:54.167425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:54.167906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:54.168682 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:54.169119 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:54.362001 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:54.370912 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:54.372456 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:54.373582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-86980117-8b39-4525-b901-a8a0e4001c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.218082 May 28 14:33:54.374149 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 625/1262] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:54 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:55.392437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:55.393054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:55.400403 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:55.400901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:55.401767 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:55.402228 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:55.601949 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:55.613961 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:55.615612 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:55.616766 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.228275 May 28 14:33:55.617322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 638/1263] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:55 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:56.637180 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:56.637824 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:56.644984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:56.645438 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:56.646244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:56.646687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:56.844299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:56.853618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:56.855938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:56.857222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-508aa076-3000-4481-b3d8-b4ff4b9c2198 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.223739 May 28 14:33:56.857829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 626/1264] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:56 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:57.877280 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:57.877860 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:57.885210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:57.890510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:57.890510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:57.890510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:58.095081 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:58.104282 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:58.105947 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:58.107011 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.234035 May 28 14:33:58.107579 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 639/1265] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:57 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:33:59.126271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:33:59.126923 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:33:59.134181 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:59.134638 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:59.136247 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:59.136691 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:59.330883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:59.341542 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:59.343161 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:33:59.344429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.221876 May 28 14:33:59.351728 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 627/1266] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:33:59 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:34:00.365988 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:00.367048 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:00.382615 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:00.383945 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:00.385606 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:00.386925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:00.630648 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:00.641667 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:00.643352 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:00.645451 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2066dfcc-d1c6-426d-9373-070b7b474f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.286416 May 28 14:34:00.646195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 640/1267] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:00 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:34:01.668401 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:01.669022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:01.676612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:01.677071 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:01.677861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:01.678302 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:01.881663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:01.891242 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:01.893046 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:01.894252 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.230356 May 28 14:34:01.894896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 628/1268] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:01 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:34:02.914043 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:02.914666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:02.921990 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:02.922454 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:02.923236 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:02.923720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:03.123228 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:03.131941 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:03.133518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:03.134669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3fbf788f-fde3-4304-95f8-87da37bbce98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.224374 May 28 14:34:03.135896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 641/1269] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:02 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:34:04.154648 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:04.155263 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:04.162565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:04.163020 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:04.163855 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:04.164307 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:04.362285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:04.371382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:04.372956 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:04.374102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.223824 May 28 14:34:04.374658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 629/1270] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:04 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:34:05.394888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:05.394888 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:05.400610 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:05.401137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:05.401966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:05.402601 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:05.605450 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:05.614341 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:05.615943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:05.617090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-217573f7-4359-4798-a61a-bee70ade7ec6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.229377 May 28 14:34:05.617652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 642/1271] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:05 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:34:06.636499 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:06.637123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:06.644341 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:06.644802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:06.645582 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:06.646027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:06.844947 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:06.853785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:06.855321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:06.856506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9e653e37-86d4-4a1b-af88-80496a477e32 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.224400 May 28 14:34:06.857128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 630/1272] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:06 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:34:07.875053 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:07.875805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:07.883865 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:07.884319 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:07.884952 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1069793046", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1591401235", "security_groups": [{"name": "tempest-secgroup-smoke-2127224596"}], "block_device_mapping_v2": [{"uuid": "feb03428-84fb-4240-9864-ece797beaf72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "89b0ce92-0695-466c-b1ce-9a354ecba633"}]}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:07.885929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:07.886091 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:08.050705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] validate_networks() for [('89b0ce92-0695-466c-b1ce-9a354ecba633', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:34:08.080396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:08.089460 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:08.091645 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:08.092811 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.221625 May 28 14:34:08.093562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 643/1273] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:07 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:34:08.347091 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-cfb968b3-3749-4856-ab83-683ad803abe6 req-4e8534cb-d77e-4b02-8b1d-5232d9e37fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d654fce7-a7f9-4505-bb9a-de526002e464", "name": "network-vif-plugged", "status": "completed", "tag": "65e6ef94-43dd-499b-b9bb-2e42a8536b59"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:08.348782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:34:08.348782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:34:08.357671 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-cfb968b3-3749-4856-ab83-683ad803abe6 req-4e8534cb-d77e-4b02-8b1d-5232d9e37fd1 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:08.358116 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-cfb968b3-3749-4856-ab83-683ad803abe6 req-4e8534cb-d77e-4b02-8b1d-5232d9e37fd1 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:08.378323 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-cfb968b3-3749-4856-ab83-683ad803abe6 req-4e8534cb-d77e-4b02-8b1d-5232d9e37fd1 service nova] Creating event network-vif-plugged:65e6ef94-43dd-499b-b9bb-2e42a8536b59 for instance d654fce7-a7f9-4505-bb9a-de526002e464 on hv-cinder-79128 May 28 14:34:08.384636 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-cfb968b3-3749-4856-ab83-683ad803abe6 req-4e8534cb-d77e-4b02-8b1d-5232d9e37fd1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041087 May 28 14:34:08.384636 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 644/1274] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:34:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:34:08.635752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:34:08.636257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:34:08.637273 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:34:08.637686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:34:08.638099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:34:08.646466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:08.646913 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:08.647763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:08.648198 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:08.665856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for project c6d2d25991f04f00a48394ddbeec688e. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:34:08.669817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Getting quotas for user 75fb81f5f54947be9db03d07ad8d6ebb and project c6d2d25991f04f00a48394ddbeec688e. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:34:08.769657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:34:08.771852 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='feb03428-84fb-4240-9864-ece797beaf72',volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:34:09.111265 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:09.111996 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:09.119486 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:09.123261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:09.123261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:09.123261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:09.274833 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.394272 May 28 14:34:09.277992 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 631/1275] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:34:07 2021] POST /compute/v2.1/servers => generated 406 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 14:34:09.285285 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7960a94a-a7e5-4b5c-adb9-d09c72cbe36f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:09.286139 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7960a94a-a7e5-4b5c-adb9-d09c72cbe36f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:09.321486 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:09.331244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:09.332810 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:09.333966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-da0e8459-54b3-4ada-97be-a21b32a66c04 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.226969 May 28 14:34:09.334529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 645/1276] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:09 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:34:09.364932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7960a94a-a7e5-4b5c-adb9-d09c72cbe36f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:09.373310 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7960a94a-a7e5-4b5c-adb9-d09c72cbe36f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1095 microversion: 2.1 time: 0.091761 May 28 14:34:09.374066 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 632/1277] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:09 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:34:10.352250 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:10.352875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:10.360189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:10.360651 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:10.361435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:10.361881 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:10.390632 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:10.391417 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:10.399033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:10.399653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:10.400486 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:10.401034 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:10.522227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:10.530771 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1145 microversion: 2.1 time: 0.144383 May 28 14:34:10.531350 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 633/1278] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:10 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1145 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:34:10.578124 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:10.586838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:10.588406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:10.589539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8c16d193-7325-4d9f-9563-eac33ef8623b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1729 microversion: 2.20 time: 0.241210 May 28 14:34:10.590701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 646/1279] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:10 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:34:11.548945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-60ce6281-77f7-48cf-a3e4-79373fe6d478 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:11.549573 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-60ce6281-77f7-48cf-a3e4-79373fe6d478 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:11.557092 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60ce6281-77f7-48cf-a3e4-79373fe6d478 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:11.557558 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60ce6281-77f7-48cf-a3e4-79373fe6d478 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:11.558351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60ce6281-77f7-48cf-a3e4-79373fe6d478 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:11.558795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60ce6281-77f7-48cf-a3e4-79373fe6d478 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:11.610416 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:11.612364 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:11.620592 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:11.621426 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:11.622725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:11.623409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:11.707436 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-60ce6281-77f7-48cf-a3e4-79373fe6d478 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:11.722792 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-60ce6281-77f7-48cf-a3e4-79373fe6d478 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1211 microversion: 2.1 time: 0.177628 May 28 14:34:11.724530 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 634/1280] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:11 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1211 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:12.011424 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:12.020587 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:12.022200 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:12.023402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1c3f616e-d769-4240-a930-caf71c9a60d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1716 microversion: 2.20 time: 0.418831 May 28 14:34:12.024215 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 647/1281] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:34:11 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1716 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 14:34:12.740519 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:12.741342 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:12.749619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:12.750181 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:12.751015 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:12.751546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:12.961884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:12.970928 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1279 microversion: 2.1 time: 0.234222 May 28 14:34:12.976648 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 635/1282] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:12 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:13.854487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-2a1d2672-81f3-4958-92ec-4d1884ef52c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53de36ab-8fe6-41ba-b6d2-785dadfa9989", "tag": "0c4d0a98-5c2e-401f-a013-9e7bf90a9c78"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:13.857004 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:34:13.857004 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:34:13.869162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-2a1d2672-81f3-4958-92ec-4d1884ef52c5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:13.869162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-2a1d2672-81f3-4958-92ec-4d1884ef52c5 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:13.884309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-2a1d2672-81f3-4958-92ec-4d1884ef52c5 service nova] Creating event network-changed:0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 for instance 53de36ab-8fe6-41ba-b6d2-785dadfa9989 on hv-cinder-79128 May 28 14:34:13.889857 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-2a1d2672-81f3-4958-92ec-4d1884ef52c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039282 May 28 14:34:13.890458 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 648/1283] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:34:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:34:13.987721 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-04c356a2-d6cb-4133-93ad-d2fe78473572 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:13.988337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-04c356a2-d6cb-4133-93ad-d2fe78473572 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:13.997118 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04c356a2-d6cb-4133-93ad-d2fe78473572 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:13.997703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04c356a2-d6cb-4133-93ad-d2fe78473572 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:13.998552 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04c356a2-d6cb-4133-93ad-d2fe78473572 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:13.999123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-04c356a2-d6cb-4133-93ad-d2fe78473572 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:14.195013 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-04c356a2-d6cb-4133-93ad-d2fe78473572 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:14.204169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-04c356a2-d6cb-4133-93ad-d2fe78473572 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.220175 May 28 14:34:14.204777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 636/1284] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:13 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:15.222092 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4c0004dc-e6b7-4efe-8004-a545fc575024 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:15.222793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4c0004dc-e6b7-4efe-8004-a545fc575024 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:15.230387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c0004dc-e6b7-4efe-8004-a545fc575024 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:15.231394 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c0004dc-e6b7-4efe-8004-a545fc575024 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:15.232203 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c0004dc-e6b7-4efe-8004-a545fc575024 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:15.232646 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4c0004dc-e6b7-4efe-8004-a545fc575024 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:15.504084 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4c0004dc-e6b7-4efe-8004-a545fc575024 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:15.512797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4c0004dc-e6b7-4efe-8004-a545fc575024 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.294825 May 28 14:34:15.513371 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 649/1285] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:15 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:34:16.531829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:16.532450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:16.539927 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:16.540380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:16.541155 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:16.541592 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:16.823804 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:16.831999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.303859 May 28 14:34:16.832569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 637/1286] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:16 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:17.849123 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-224bf8d0-4893-4121-993b-ec67c43032fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:17.849753 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-224bf8d0-4893-4121-993b-ec67c43032fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:17.857542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-224bf8d0-4893-4121-993b-ec67c43032fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:17.858006 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-224bf8d0-4893-4121-993b-ec67c43032fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:17.858793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-224bf8d0-4893-4121-993b-ec67c43032fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:17.859240 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-224bf8d0-4893-4121-993b-ec67c43032fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:18.046505 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:34:18.046734 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: Fri May 28 14:34:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 (ip 10.222.0.59) !!! May 28 14:34:18.060591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-224bf8d0-4893-4121-993b-ec67c43032fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:18.072843 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-224bf8d0-4893-4121-993b-ec67c43032fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.227311 May 28 14:34:18.073354 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 650/1287] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:17 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:19.089576 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7743edc6-f952-48b7-b432-df29eb0fee79 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:19.090123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7743edc6-f952-48b7-b432-df29eb0fee79 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:19.097381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7743edc6-f952-48b7-b432-df29eb0fee79 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:19.097833 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7743edc6-f952-48b7-b432-df29eb0fee79 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:19.098596 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7743edc6-f952-48b7-b432-df29eb0fee79 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:19.099031 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7743edc6-f952-48b7-b432-df29eb0fee79 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:19.295637 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7743edc6-f952-48b7-b432-df29eb0fee79 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:19.303772 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7743edc6-f952-48b7-b432-df29eb0fee79 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.218078 May 28 14:34:19.304337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 638/1288] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:19 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:20.321044 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7505c792-a91a-411a-903a-976d0ccdb6fd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:20.321650 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7505c792-a91a-411a-903a-976d0ccdb6fd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:20.329744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7505c792-a91a-411a-903a-976d0ccdb6fd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:20.330191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7505c792-a91a-411a-903a-976d0ccdb6fd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:20.330969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7505c792-a91a-411a-903a-976d0ccdb6fd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:20.331409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7505c792-a91a-411a-903a-976d0ccdb6fd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:20.524179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7505c792-a91a-411a-903a-976d0ccdb6fd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:20.532387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7505c792-a91a-411a-903a-976d0ccdb6fd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.215099 May 28 14:34:20.532962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 651/1289] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:20 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:21.550289 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-aba3e526-4525-4a3a-bf71-4376383783c7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:21.550907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-aba3e526-4525-4a3a-bf71-4376383783c7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:21.559737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aba3e526-4525-4a3a-bf71-4376383783c7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:21.560195 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aba3e526-4525-4a3a-bf71-4376383783c7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:21.560988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aba3e526-4525-4a3a-bf71-4376383783c7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:21.561433 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-aba3e526-4525-4a3a-bf71-4376383783c7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:21.893124 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-aba3e526-4525-4a3a-bf71-4376383783c7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:21.901224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-aba3e526-4525-4a3a-bf71-4376383783c7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.354638 May 28 14:34:21.901785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 639/1290] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:21 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:22.918080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-14e33264-790d-4d0b-b92c-05b720304067 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:22.918725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-14e33264-790d-4d0b-b92c-05b720304067 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:22.926721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14e33264-790d-4d0b-b92c-05b720304067 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:22.927173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14e33264-790d-4d0b-b92c-05b720304067 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:22.927981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14e33264-790d-4d0b-b92c-05b720304067 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:22.928418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-14e33264-790d-4d0b-b92c-05b720304067 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:23.125954 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-14e33264-790d-4d0b-b92c-05b720304067 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:23.134358 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-14e33264-790d-4d0b-b92c-05b720304067 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.220133 May 28 14:34:23.143980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 652/1291] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:22 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:23.171346 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0de624a3-cf54-4c3a-a7be-7c189001c595 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:23.171936 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0de624a3-cf54-4c3a-a7be-7c189001c595 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:23.178986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0de624a3-cf54-4c3a-a7be-7c189001c595 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:23.179452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0de624a3-cf54-4c3a-a7be-7c189001c595 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:23.180290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0de624a3-cf54-4c3a-a7be-7c189001c595 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:23.180734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0de624a3-cf54-4c3a-a7be-7c189001c595 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:23.235954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-0de624a3-cf54-4c3a-a7be-7c189001c595 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lazy-loading 'flavor' on Instance uuid 2477e125-22c2-4367-b28c-0aaf5754b37c {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:34:23.554215 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0de624a3-cf54-4c3a-a7be-7c189001c595 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c/action" status: 202 len: 0 microversion: 2.1 time: 0.386487 May 28 14:34:23.554821 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 640/1292] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:34:23 2021] POST /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:34:23.564034 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6bdec10f-10ff-42fb-963f-5280e7e56c4b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:23.564663 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6bdec10f-10ff-42fb-963f-5280e7e56c4b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:23.572135 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6bdec10f-10ff-42fb-963f-5280e7e56c4b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:23.572599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6bdec10f-10ff-42fb-963f-5280e7e56c4b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:23.573397 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6bdec10f-10ff-42fb-963f-5280e7e56c4b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:23.573846 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6bdec10f-10ff-42fb-963f-5280e7e56c4b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:23.772211 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6bdec10f-10ff-42fb-963f-5280e7e56c4b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:23.780520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6bdec10f-10ff-42fb-963f-5280e7e56c4b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.220879 May 28 14:34:23.781078 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 653/1293] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:23 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:24.151939 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:24.152561 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:24.160559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:24.161021 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:24.161795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:24.162236 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:24.361002 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:24.369160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.221474 May 28 14:34:24.369725 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 641/1294] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:24 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:24.517815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-f355f8a4-2af2-47df-89d7-1756875d8146 req-080ceda8-b0aa-4fa9-bc7d-210cc9113e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53de36ab-8fe6-41ba-b6d2-785dadfa9989", "name": "network-vif-plugged", "status": "completed", "tag": "0c4d0a98-5c2e-401f-a013-9e7bf90a9c78"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:24.519410 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:34:24.519410 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:34:24.527851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-f355f8a4-2af2-47df-89d7-1756875d8146 req-080ceda8-b0aa-4fa9-bc7d-210cc9113e2f service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:24.528926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-f355f8a4-2af2-47df-89d7-1756875d8146 req-080ceda8-b0aa-4fa9-bc7d-210cc9113e2f service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:24.544310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-f355f8a4-2af2-47df-89d7-1756875d8146 req-080ceda8-b0aa-4fa9-bc7d-210cc9113e2f service nova] Creating event network-vif-plugged:0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 for instance 53de36ab-8fe6-41ba-b6d2-785dadfa9989 on hv-cinder-79128 May 28 14:34:24.549128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-f355f8a4-2af2-47df-89d7-1756875d8146 req-080ceda8-b0aa-4fa9-bc7d-210cc9113e2f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035105 May 28 14:34:24.549705 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 654/1295] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:34:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:34:24.796979 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9a6db976-d072-4dfe-a648-8b8c9ca8397d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:24.797554 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9a6db976-d072-4dfe-a648-8b8c9ca8397d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:24.804920 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a6db976-d072-4dfe-a648-8b8c9ca8397d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:24.805384 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a6db976-d072-4dfe-a648-8b8c9ca8397d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:24.806282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a6db976-d072-4dfe-a648-8b8c9ca8397d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:24.806726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a6db976-d072-4dfe-a648-8b8c9ca8397d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:25.000704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9a6db976-d072-4dfe-a648-8b8c9ca8397d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:25.009103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9a6db976-d072-4dfe-a648-8b8c9ca8397d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.216048 May 28 14:34:25.009884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 642/1296] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:24 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:25.386835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:25.387456 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:25.394891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:25.395338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:25.396144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:25.396581 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:25.597712 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:25.605160 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1267 microversion: 2.1 time: 0.222611 May 28 14:34:25.605729 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 655/1297] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:25 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:26.026827 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c4f1b197-15b1-42c9-be92-9b6291e20a2c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:26.027443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c4f1b197-15b1-42c9-be92-9b6291e20a2c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:26.035454 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c4f1b197-15b1-42c9-be92-9b6291e20a2c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:26.035935 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c4f1b197-15b1-42c9-be92-9b6291e20a2c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:26.036704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c4f1b197-15b1-42c9-be92-9b6291e20a2c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:26.037145 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c4f1b197-15b1-42c9-be92-9b6291e20a2c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:26.234440 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c4f1b197-15b1-42c9-be92-9b6291e20a2c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:26.242734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c4f1b197-15b1-42c9-be92-9b6291e20a2c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.219616 May 28 14:34:26.243292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 643/1298] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:26 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:26.622642 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:26.623276 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:26.630707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:26.631170 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:26.631999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:26.632446 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:26.825537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:26.833930 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1455 microversion: 2.1 time: 0.216049 May 28 14:34:26.839829 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 656/1299] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:26 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1455 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:26.849548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:26.850162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:26.857897 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:26.858343 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:26.859105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:26.859548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:27.065643 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:27.073938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1455 microversion: 2.1 time: 0.228079 May 28 14:34:27.074502 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 644/1300] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:26 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1455 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:27.262459 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:27.262459 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:27.270398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:27.270865 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:27.271801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:27.272252 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:27.469478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:27.478099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.221216 May 28 14:34:27.483692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 657/1301] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:27 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:28.497271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:28.503590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:28.505372 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:28.505841 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:28.506631 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:28.507074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:28.958604 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:28.967948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.474671 May 28 14:34:28.968537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 645/1302] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:28 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:34:29.985657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a8727dde-b73f-4a71-947e-90f38f11ef12 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:29.986960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a8727dde-b73f-4a71-947e-90f38f11ef12 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:29.993546 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a8727dde-b73f-4a71-947e-90f38f11ef12 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:29.994020 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a8727dde-b73f-4a71-947e-90f38f11ef12 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:29.995033 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a8727dde-b73f-4a71-947e-90f38f11ef12 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:29.995483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a8727dde-b73f-4a71-947e-90f38f11ef12 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:30.165932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-3399e4d6-7033-45de-8330-10128f6baf03 req-2c00de7f-1030-4148-9afe-c94d246b603c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53de36ab-8fe6-41ba-b6d2-785dadfa9989", "tag": "0c4d0a98-5c2e-401f-a013-9e7bf90a9c78"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:30.167634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:34:30.167634 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:34:30.177155 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-3399e4d6-7033-45de-8330-10128f6baf03 req-2c00de7f-1030-4148-9afe-c94d246b603c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:30.177953 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-3399e4d6-7033-45de-8330-10128f6baf03 req-2c00de7f-1030-4148-9afe-c94d246b603c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:30.194145 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-3399e4d6-7033-45de-8330-10128f6baf03 req-2c00de7f-1030-4148-9afe-c94d246b603c service nova] Creating event network-changed:0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 for instance 53de36ab-8fe6-41ba-b6d2-785dadfa9989 on hv-cinder-79128 May 28 14:34:30.199131 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-3399e4d6-7033-45de-8330-10128f6baf03 req-2c00de7f-1030-4148-9afe-c94d246b603c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097678 May 28 14:34:30.199905 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 646/1303] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:34:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:34:30.213856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a8727dde-b73f-4a71-947e-90f38f11ef12 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:30.222816 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a8727dde-b73f-4a71-947e-90f38f11ef12 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.241558 May 28 14:34:30.223392 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 658/1304] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:29 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:31.240393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:31.241102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:31.249902 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:31.250442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:31.251233 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:31.251728 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:31.452126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:31.460901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.224657 May 28 14:34:31.461477 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 647/1305] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:31 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:34:32.478296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:32.478921 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:32.487387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:32.487883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:32.488703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:32.489153 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:32.689083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:32.697299 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.222821 May 28 14:34:32.697875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 659/1306] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:32 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:33.714189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-bb6c39e2-d4be-4d0f-a774-9704aa62988d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:33.729718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-bb6c39e2-d4be-4d0f-a774-9704aa62988d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:33.729718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bb6c39e2-d4be-4d0f-a774-9704aa62988d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:33.729718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bb6c39e2-d4be-4d0f-a774-9704aa62988d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:33.729718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bb6c39e2-d4be-4d0f-a774-9704aa62988d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:33.730541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-bb6c39e2-d4be-4d0f-a774-9704aa62988d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:34.009389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-bb6c39e2-d4be-4d0f-a774-9704aa62988d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:34.018299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-bb6c39e2-d4be-4d0f-a774-9704aa62988d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.307822 May 28 14:34:34.019062 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 648/1307] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:33 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:35.036080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:35.036701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:35.044017 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:35.044503 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:35.045285 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:35.045809 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:35.240973 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:35.249974 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.217593 May 28 14:34:35.250568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 660/1308] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:35 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:36.267803 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-57c3eccf-0156-4a0c-b869-3f02c34d85fe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:36.268406 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-57c3eccf-0156-4a0c-b869-3f02c34d85fe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:36.276535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-57c3eccf-0156-4a0c-b869-3f02c34d85fe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:36.276535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-57c3eccf-0156-4a0c-b869-3f02c34d85fe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:36.277282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-57c3eccf-0156-4a0c-b869-3f02c34d85fe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:36.277727 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-57c3eccf-0156-4a0c-b869-3f02c34d85fe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:36.476254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-57c3eccf-0156-4a0c-b869-3f02c34d85fe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:36.485480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-57c3eccf-0156-4a0c-b869-3f02c34d85fe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.222363 May 28 14:34:36.486051 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 649/1309] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:36 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:37.502027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-31853a3f-4700-4a31-91d4-b5787a33f0c4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:37.502775 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-31853a3f-4700-4a31-91d4-b5787a33f0c4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:37.510106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31853a3f-4700-4a31-91d4-b5787a33f0c4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:37.510545 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31853a3f-4700-4a31-91d4-b5787a33f0c4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:37.511328 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31853a3f-4700-4a31-91d4-b5787a33f0c4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:37.511797 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-31853a3f-4700-4a31-91d4-b5787a33f0c4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:37.711787 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-31853a3f-4700-4a31-91d4-b5787a33f0c4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:37.723490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-31853a3f-4700-4a31-91d4-b5787a33f0c4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.224755 May 28 14:34:37.724526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 661/1310] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:37 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:38.742160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4ef85a17-8ea2-4a80-aa73-7f056590073f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:38.742781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4ef85a17-8ea2-4a80-aa73-7f056590073f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:38.751098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4ef85a17-8ea2-4a80-aa73-7f056590073f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:38.751577 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4ef85a17-8ea2-4a80-aa73-7f056590073f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:38.757352 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4ef85a17-8ea2-4a80-aa73-7f056590073f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:38.757352 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4ef85a17-8ea2-4a80-aa73-7f056590073f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:38.947150 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4ef85a17-8ea2-4a80-aa73-7f056590073f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:38.955390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4ef85a17-8ea2-4a80-aa73-7f056590073f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1508 microversion: 2.1 time: 0.217154 May 28 14:34:38.955988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 650/1311] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:38 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:38.972008 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b9a6b045-c310-4876-b508-485a5aa2d438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:38.972589 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b9a6b045-c310-4876-b508-485a5aa2d438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:38.979835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b9a6b045-c310-4876-b508-485a5aa2d438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:38.980293 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b9a6b045-c310-4876-b508-485a5aa2d438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:38.981068 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b9a6b045-c310-4876-b508-485a5aa2d438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:38.981510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b9a6b045-c310-4876-b508-485a5aa2d438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:39.289353 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b9a6b045-c310-4876-b508-485a5aa2d438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c/action" status: 202 len: 0 microversion: 2.1 time: 0.320987 May 28 14:34:39.289972 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 662/1312] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:34:38 2021] POST /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:34:39.298407 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a3315e47-729d-47eb-9a56-704fbb034448 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:39.299199 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a3315e47-729d-47eb-9a56-704fbb034448 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:39.306523 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a3315e47-729d-47eb-9a56-704fbb034448 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:39.307088 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a3315e47-729d-47eb-9a56-704fbb034448 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:39.307925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a3315e47-729d-47eb-9a56-704fbb034448 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:39.308374 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a3315e47-729d-47eb-9a56-704fbb034448 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:39.505669 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a3315e47-729d-47eb-9a56-704fbb034448 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:39.515079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a3315e47-729d-47eb-9a56-704fbb034448 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1516 microversion: 2.1 time: 0.220496 May 28 14:34:39.515987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 651/1313] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:39 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:40.425711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-b9e3422b-ce28-478f-97e4-3a01260dea2e req-9a06687b-df9b-46c1-932c-ab446614f5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2477e125-22c2-4367-b28c-0aaf5754b37c", "name": "network-vif-unplugged", "status": "completed", "tag": "e27f7a0e-7e77-4d61-a393-fe4fde4153d5"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:40.425711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:34:40.425711 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:34:40.429658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-b9e3422b-ce28-478f-97e4-3a01260dea2e req-9a06687b-df9b-46c1-932c-ab446614f5e1 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:40.430112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-b9e3422b-ce28-478f-97e4-3a01260dea2e req-9a06687b-df9b-46c1-932c-ab446614f5e1 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:40.446106 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.compute.server_external_events [req-b9e3422b-ce28-478f-97e4-3a01260dea2e req-9a06687b-df9b-46c1-932c-ab446614f5e1 service nova] Unable to find a host for instance 2477e125-22c2-4367-b28c-0aaf5754b37c. Dropping event network-vif-unplugged {{(pid=106811) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 28 14:34:40.446986 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-b9e3422b-ce28-478f-97e4-3a01260dea2e req-9a06687b-df9b-46c1-932c-ab446614f5e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031910 May 28 14:34:40.447586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 663/1314] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 14:34:40.532741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:40.533283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:40.540962 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:40.541423 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:40.542213 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:40.542663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:40.743730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:40.752392 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1516 microversion: 2.1 time: 0.223986 May 28 14:34:40.752953 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 652/1315] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:40 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:41.769934 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:41.770483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:41.777848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:41.778305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:41.779165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:41.779633 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:41.975643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:41.984498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1516 microversion: 2.1 time: 0.218321 May 28 14:34:41.985072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 664/1316] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:41 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:43.001625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9b330436-2129-4801-becb-9137d17309e3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:43.002261 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9b330436-2129-4801-becb-9137d17309e3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:43.009466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9b330436-2129-4801-becb-9137d17309e3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:43.009993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9b330436-2129-4801-becb-9137d17309e3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:43.010770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9b330436-2129-4801-becb-9137d17309e3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:43.011208 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9b330436-2129-4801-becb-9137d17309e3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:43.207849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9b330436-2129-4801-becb-9137d17309e3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:43.216283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9b330436-2129-4801-becb-9137d17309e3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1518 microversion: 2.1 time: 0.218624 May 28 14:34:43.217890 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 653/1317] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:42 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:34:44.234584 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c29d8762-8bd6-4f2a-b506-c72b45193afe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:44.235182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c29d8762-8bd6-4f2a-b506-c72b45193afe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:44.242375 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c29d8762-8bd6-4f2a-b506-c72b45193afe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:44.242880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c29d8762-8bd6-4f2a-b506-c72b45193afe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:44.243677 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c29d8762-8bd6-4f2a-b506-c72b45193afe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:44.244118 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c29d8762-8bd6-4f2a-b506-c72b45193afe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:44.445405 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c29d8762-8bd6-4f2a-b506-c72b45193afe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:44.453785 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c29d8762-8bd6-4f2a-b506-c72b45193afe tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.223645 May 28 14:34:44.454361 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 665/1318] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:44 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:45.471105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4c8c5484-45cb-4579-9cf9-e9032facf449 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:45.471795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4c8c5484-45cb-4579-9cf9-e9032facf449 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:45.479200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4c8c5484-45cb-4579-9cf9-e9032facf449 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:45.479773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4c8c5484-45cb-4579-9cf9-e9032facf449 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:45.480569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4c8c5484-45cb-4579-9cf9-e9032facf449 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:45.481008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4c8c5484-45cb-4579-9cf9-e9032facf449 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:45.689382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-4c8c5484-45cb-4579-9cf9-e9032facf449 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:45.698335 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4c8c5484-45cb-4579-9cf9-e9032facf449 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.231118 May 28 14:34:45.701009 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 654/1319] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:45 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:46.715757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-243338cb-66f2-4c5c-a5b7-0be0462c20cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:46.716355 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-243338cb-66f2-4c5c-a5b7-0be0462c20cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:46.724258 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-243338cb-66f2-4c5c-a5b7-0be0462c20cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:46.724718 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-243338cb-66f2-4c5c-a5b7-0be0462c20cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:46.725511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-243338cb-66f2-4c5c-a5b7-0be0462c20cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:46.725985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-243338cb-66f2-4c5c-a5b7-0be0462c20cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:46.922553 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-243338cb-66f2-4c5c-a5b7-0be0462c20cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:46.930974 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-243338cb-66f2-4c5c-a5b7-0be0462c20cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.219188 May 28 14:34:46.931569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 666/1320] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:46 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:47.948358 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:47.948971 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:47.956266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:47.956747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:47.957513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:47.957950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:48.150972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:48.159872 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.215185 May 28 14:34:48.160442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 655/1321] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:47 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:49.177274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dfbb261f-d99f-427a-bc0d-cb60852eed9f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:49.177899 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-dfbb261f-d99f-427a-bc0d-cb60852eed9f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:49.185175 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfbb261f-d99f-427a-bc0d-cb60852eed9f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:49.185640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfbb261f-d99f-427a-bc0d-cb60852eed9f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:49.186425 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfbb261f-d99f-427a-bc0d-cb60852eed9f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:49.187446 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dfbb261f-d99f-427a-bc0d-cb60852eed9f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:49.379643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-dfbb261f-d99f-427a-bc0d-cb60852eed9f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:49.387925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-dfbb261f-d99f-427a-bc0d-cb60852eed9f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.214267 May 28 14:34:49.388490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 667/1322] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:49 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:50.409076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ed0c7134-109b-456d-8f96-dee82beaeb7e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:50.409720 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ed0c7134-109b-456d-8f96-dee82beaeb7e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:50.416988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ed0c7134-109b-456d-8f96-dee82beaeb7e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:50.417441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ed0c7134-109b-456d-8f96-dee82beaeb7e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:50.418206 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ed0c7134-109b-456d-8f96-dee82beaeb7e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:50.418647 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ed0c7134-109b-456d-8f96-dee82beaeb7e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:50.616058 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ed0c7134-109b-456d-8f96-dee82beaeb7e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:50.625166 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ed0c7134-109b-456d-8f96-dee82beaeb7e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.219882 May 28 14:34:50.625735 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 656/1323] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:50 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:51.641334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:51.641970 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:51.649211 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:51.649665 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:51.650432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:51.650869 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:51.846570 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:51.855418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.217812 May 28 14:34:51.856017 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 668/1324] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:51 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:52.873465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:52.874086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:52.882093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:52.882549 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:52.883327 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:52.883802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:53.077098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:53.085262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.215937 May 28 14:34:53.085826 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 657/1325] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:52 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:54.102563 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:54.103140 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:54.110435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:54.110892 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:54.111706 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:54.112149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:54.308163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:54.317000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.218279 May 28 14:34:54.317583 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 669/1326] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:54 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:55.334379 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a5a4435e-8b9a-468c-acd9-972330a806f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:55.334995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a5a4435e-8b9a-468c-acd9-972330a806f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:55.342298 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5a4435e-8b9a-468c-acd9-972330a806f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:55.342746 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5a4435e-8b9a-468c-acd9-972330a806f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:55.343511 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5a4435e-8b9a-468c-acd9-972330a806f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:55.343972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5a4435e-8b9a-468c-acd9-972330a806f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:55.536280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a5a4435e-8b9a-468c-acd9-972330a806f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:55.544765 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a5a4435e-8b9a-468c-acd9-972330a806f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.214733 May 28 14:34:55.545331 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 658/1327] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:55 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:56.561721 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-51228cba-f288-4f3a-b502-fe77944f103f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:56.562432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-51228cba-f288-4f3a-b502-fe77944f103f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:56.569671 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51228cba-f288-4f3a-b502-fe77944f103f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:56.570121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51228cba-f288-4f3a-b502-fe77944f103f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:56.570891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51228cba-f288-4f3a-b502-fe77944f103f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:56.571334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51228cba-f288-4f3a-b502-fe77944f103f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:56.769971 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-51228cba-f288-4f3a-b502-fe77944f103f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:56.778609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-51228cba-f288-4f3a-b502-fe77944f103f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.220682 May 28 14:34:56.779173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 670/1328] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:56 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:57.796191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-43592acd-a780-4c0e-8f17-82ae3c38b8ee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:57.796875 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-43592acd-a780-4c0e-8f17-82ae3c38b8ee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:57.805257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-43592acd-a780-4c0e-8f17-82ae3c38b8ee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:57.805754 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-43592acd-a780-4c0e-8f17-82ae3c38b8ee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:57.806588 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-43592acd-a780-4c0e-8f17-82ae3c38b8ee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:57.807035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-43592acd-a780-4c0e-8f17-82ae3c38b8ee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:58.007561 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-43592acd-a780-4c0e-8f17-82ae3c38b8ee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:58.015821 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-43592acd-a780-4c0e-8f17-82ae3c38b8ee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.223371 May 28 14:34:58.016383 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 659/1329] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:57 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:34:58.610840 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-590661a7-7a10-4827-94c2-862a7815b32b req-a27004f0-2c1b-42f4-8f76-7e529a6f1a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2477e125-22c2-4367-b28c-0aaf5754b37c", "name": "network-vif-plugged", "status": "completed", "tag": "e27f7a0e-7e77-4d61-a393-fe4fde4153d5"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:34:58.611695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:34:58.611695 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:34:58.620082 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-590661a7-7a10-4827-94c2-862a7815b32b req-a27004f0-2c1b-42f4-8f76-7e529a6f1a0f service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:58.620537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-590661a7-7a10-4827-94c2-862a7815b32b req-a27004f0-2c1b-42f4-8f76-7e529a6f1a0f service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:58.639281 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-590661a7-7a10-4827-94c2-862a7815b32b req-a27004f0-2c1b-42f4-8f76-7e529a6f1a0f service nova] Creating event network-vif-plugged:e27f7a0e-7e77-4d61-a393-fe4fde4153d5 for instance 2477e125-22c2-4367-b28c-0aaf5754b37c on hv-cinder-79128 May 28 14:34:58.645060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-590661a7-7a10-4827-94c2-862a7815b32b req-a27004f0-2c1b-42f4-8f76-7e529a6f1a0f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039631 May 28 14:34:58.645508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 671/1330] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:34:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:34:59.032580 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:34:59.033134 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:34:59.040815 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:59.041272 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:59.042042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:34:59.042481 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:59.232396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:34:59.241177 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.212335 May 28 14:34:59.241687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 660/1331] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:34:59 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:35:00.259454 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4cf557c0-45a5-4521-9227-221e66b0d53e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:00.260362 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4cf557c0-45a5-4521-9227-221e66b0d53e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:00.268277 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4cf557c0-45a5-4521-9227-221e66b0d53e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:00.268735 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4cf557c0-45a5-4521-9227-221e66b0d53e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:00.269537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4cf557c0-45a5-4521-9227-221e66b0d53e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:00.269979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4cf557c0-45a5-4521-9227-221e66b0d53e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:00.478897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-4cf557c0-45a5-4521-9227-221e66b0d53e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:00.487764 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4cf557c0-45a5-4521-9227-221e66b0d53e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1574 microversion: 2.1 time: 0.232599 May 28 14:35:00.488456 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 672/1332] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:35:00 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:35:01.505583 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6fb75f81-4b41-40bd-8f23-75500c2036ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:01.506185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6fb75f81-4b41-40bd-8f23-75500c2036ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:01.513613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6fb75f81-4b41-40bd-8f23-75500c2036ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:01.514072 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6fb75f81-4b41-40bd-8f23-75500c2036ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:01.514854 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6fb75f81-4b41-40bd-8f23-75500c2036ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:01.515290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6fb75f81-4b41-40bd-8f23-75500c2036ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:01.708630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6fb75f81-4b41-40bd-8f23-75500c2036ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:01.717007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6fb75f81-4b41-40bd-8f23-75500c2036ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1561 microversion: 2.1 time: 0.215713 May 28 14:35:01.722911 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 661/1333] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:35:01 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1561 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:35:28.815502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fe8ca3e-90e0-4fe8-82f1-09a499ae25c7] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:35:28.818830 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-16f2e9b6-2985-4ce6-bedc-351783d9d453 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:28.819337 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-16f2e9b6-2985-4ce6-bedc-351783d9d453 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:28.826617 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16f2e9b6-2985-4ce6-bedc-351783d9d453 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:28.827080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16f2e9b6-2985-4ce6-bedc-351783d9d453 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:28.827889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16f2e9b6-2985-4ce6-bedc-351783d9d453 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:28.828338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-16f2e9b6-2985-4ce6-bedc-351783d9d453 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:28.888561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-16f2e9b6-2985-4ce6-bedc-351783d9d453 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:35:29.211964 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-16f2e9b6-2985-4ce6-bedc-351783d9d453 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 204 len: 0 microversion: 2.20 time: 0.397545 May 28 14:35:29.212567 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 673/1334] 10.222.0.59 () {60 vars in 1280 bytes} [Fri May 28 14:35:28 2021] DELETE /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 14:35:29.221387 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:29.222006 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:29.229316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:29.230433 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:29.231216 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:29.231693 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:29.431277 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:29.440044 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:29.441594 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:29.442737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.225262 May 28 14:35:29.443295 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 662/1335] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:35:29 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:35:30.461674 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:30.462409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:30.486083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:30.486537 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:30.487397 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:30.487874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:30.488603 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fe8ca3e-90e0-4fe8-82f1-09a499ae25c7] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 55502. May 28 14:35:30.685675 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:30.694398 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:30.695944 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:30.697093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a7d5d99c-88df-4a98-85ec-6379699786dc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.239684 May 28 14:35:30.697674 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 674/1336] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:35:30 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:35:31.717011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:31.717632 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:31.725037 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:31.725498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:31.726282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:31.726725 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:31.922348 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:31.931104 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:31.933299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:31.934433 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-adf466d9-f0b5-4a04-9550-7a08dbef4391 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1722 microversion: 2.20 time: 0.221298 May 28 14:35:31.934986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 663/1337] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:35:31 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:35:32.560989 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-f428beeb-913b-4785-8114-ae8eb7d37ff7 req-c80f88d8-e715-4803-b4cf-531b07fabe2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d654fce7-a7f9-4505-bb9a-de526002e464", "name": "network-vif-deleted", "tag": "65e6ef94-43dd-499b-b9bb-2e42a8536b59"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:35:32.562861 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:35:32.562861 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:35:32.572110 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-f428beeb-913b-4785-8114-ae8eb7d37ff7 req-c80f88d8-e715-4803-b4cf-531b07fabe2c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:32.572610 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-f428beeb-913b-4785-8114-ae8eb7d37ff7 req-c80f88d8-e715-4803-b4cf-531b07fabe2c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:32.588897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-f428beeb-913b-4785-8114-ae8eb7d37ff7 req-c80f88d8-e715-4803-b4cf-531b07fabe2c service nova] Creating event network-vif-deleted:65e6ef94-43dd-499b-b9bb-2e42a8536b59 for instance d654fce7-a7f9-4505-bb9a-de526002e464 on hv-cinder-79128 May 28 14:35:32.594141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-f428beeb-913b-4785-8114-ae8eb7d37ff7 req-c80f88d8-e715-4803-b4cf-531b07fabe2c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037225 May 28 14:35:32.594737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 675/1338] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:35:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:35:32.952879 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:32.953472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:32.960933 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:32.961384 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:32.962157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:32.962590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:33.032929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:33.033378 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:33.033829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lazy-loading 'fault' on Instance uuid d654fce7-a7f9-4505-bb9a-de526002e464 {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:35:33.092232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:33.101012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:33.102546 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5d9664f5ec42ce8aa849388e53c404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:33.103719 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1bad5471-20ab-47e5-9910-8231f17dd7ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 200 len: 1371 microversion: 2.20 time: 0.154683 May 28 14:35:33.104292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 664/1339] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:35:32 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 14:35:34.122029 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:34.122757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:34.130209 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:34.130664 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:34.131435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:34.131902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:34.180104 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] HTTP exception thrown: Instance d654fce7-a7f9-4505-bb9a-de526002e464 could not be found. May 28 14:35:34.180698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Returning 404 to user: Instance d654fce7-a7f9-4505-bb9a-de526002e464 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:35:34.181518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d2fa62b5-3dcb-4b2d-b3be-e89950addec5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 404 len: 111 microversion: 2.20 time: 0.064110 May 28 14:35:34.182055 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 676/1340] 10.222.0.59 () {60 vars in 1277 bytes} [Fri May 28 14:35:34 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 14:35:34.190480 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2959678d-236e-481d-8657-081644fc61cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '.version_select at 0x7f2aad16a0d0>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:34.299353 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2959678d-236e-481d-8657-081644fc61cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152347964" status: 204 len: 0 microversion: 2.20 time: 0.112378 May 28 14:35:34.299896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 665/1341] 10.222.0.59 () {60 vars in 1262 bytes} [Fri May 28 14:35:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152347964 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 14:35:36.835527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:36.836062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:36.843904 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:36.844367 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:36.845148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:36.845597 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:36.894576 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] HTTP exception thrown: Instance d654fce7-a7f9-4505-bb9a-de526002e464 could not be found. May 28 14:35:36.895183 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Returning 404 to user: Instance d654fce7-a7f9-4505-bb9a-de526002e464 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:35:36.896062 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2d7bc328-673f-4bd1-afd7-7c2f8dbccdb3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 404 len: 111 microversion: 2.1 time: 0.064432 May 28 14:35:36.896609 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 677/1342] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:35:36 2021] DELETE /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:35:36.905312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:36.905927 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: d654fce7-a7f9-4505-bb9a-de526002e464] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:36.913602 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:36.914058 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:36.914828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:36.915264 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:36.963431 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] HTTP exception thrown: Instance d654fce7-a7f9-4505-bb9a-de526002e464 could not be found. May 28 14:35:36.964054 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Returning 404 to user: Instance d654fce7-a7f9-4505-bb9a-de526002e464 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:35:36.965370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cef01254-11c5-4d2a-b8f2-7307b80ddffb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464" status: 404 len: 111 microversion: 2.1 time: 0.064395 May 28 14:35:36.965919 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 666/1343] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:35:36 2021] GET /compute/v2.1/servers/d654fce7-a7f9-4505-bb9a-de526002e464 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:35:38.361328 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:38.368303 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:38.369441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:38.369900 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:38.371181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:38.371657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:38.423793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] HTTP exception thrown: Instance 2c36e73b-e6ab-4203-ada8-e971693460e2 could not be found. May 28 14:35:38.424397 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Returning 404 to user: Instance 2c36e73b-e6ab-4203-ada8-e971693460e2 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:35:38.425254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ea152722-93b1-4a51-8fe2-068424e4333c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 404 len: 111 microversion: 2.1 time: 0.067759 May 28 14:35:38.425812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 678/1344] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:35:38 2021] DELETE /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:35:38.434076 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:38.434696 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] [instance: 2c36e73b-e6ab-4203-ada8-e971693460e2] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:38.442086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:38.442541 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:38.443307 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:38.443783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:38.495011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] HTTP exception thrown: Instance 2c36e73b-e6ab-4203-ada8-e971693460e2 could not be found. May 28 14:35:38.496130 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Returning 404 to user: Instance 2c36e73b-e6ab-4203-ada8-e971693460e2 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:35:38.496950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6652d1ef-96dd-4bd9-99aa-5cd83c15adf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2" status: 404 len: 111 microversion: 2.1 time: 0.067101 May 28 14:35:38.497483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 667/1345] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:35:38 2021] GET /compute/v2.1/servers/2c36e73b-e6ab-4203-ada8-e971693460e2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:35:53.835275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-69e8bb98-9efe-486d-8538-d8785a8cac22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'create', calling method: .version_select at 0x7f2aad824e50>, body: {"keypair": {"name": "tempest-keypair-2122996061"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:35:53.858440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-69e8bb98-9efe-486d-8538-d8785a8cac22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'key_pairs'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:35:53.862542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-69e8bb98-9efe-486d-8538-d8785a8cac22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for user 8c4e743e57e44cd78fe2e68ea8d97eb5 and project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'key_pairs'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:35:54.241777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-69e8bb98-9efe-486d-8538-d8785a8cac22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'key_pairs'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:35:54.246452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-69e8bb98-9efe-486d-8538-d8785a8cac22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for user 8c4e743e57e44cd78fe2e68ea8d97eb5 and project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'key_pairs'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:35:54.259355 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-69e8bb98-9efe-486d-8538-d8785a8cac22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.589614 May 28 14:35:54.259991 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 679/1346] 10.222.0.59 () {60 vars in 1158 bytes} [Fri May 28 14:35:53 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:35:57.015123 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e218803b-6856-4257-89a8-6a2e16c4d566] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:35:57.019055 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1787045105", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d07aad82-58f0-48c7-bdbc-4ebfe5f698dc"}], "security_groups": [{"name": "tempest-securitygroup--986428465"}], "key_name": "tempest-keypair-2122996061", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:35:57.135211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.network.neutron [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] validate_networks() for [('d07aad82-58f0-48c7-bdbc-4ebfe5f698dc', None, None, None)] {{(pid=106812) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:35:57.762391 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Flavor limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:35:57.762817 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Image limits 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:35:57.763305 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Flavor pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:35:57.763750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Image pref 0:0:0 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:35:57.764163 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.virt.hardware [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:35:57.772459 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:57.772909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:57.773718 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:57.774153 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:57.791671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:35:57.796132 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for user 8c4e743e57e44cd78fe2e68ea8d97eb5 and project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'ram', 'cores', 'instances'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:35:57.806756 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Going to run 1 instances... {{(pid=106812) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:35:57.809122 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:35:57.933466 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8110438d-d25e-44c9-85d7-4a01721e396c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.919630 May 28 14:35:57.934221 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 668/1347] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:35:57 2021] POST /compute/v2.1/servers => generated 401 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:35:57.943891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a52b9b4d-c588-4c7b-9e02-fdb7b2230541 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:57.944523 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a52b9b4d-c588-4c7b-9e02-fdb7b2230541 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:58.017445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a52b9b4d-c588-4c7b-9e02-fdb7b2230541 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:58.025478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a52b9b4d-c588-4c7b-9e02-fdb7b2230541 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1238 microversion: 2.1 time: 0.085293 May 28 14:35:58.026060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 680/1348] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:35:57 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:35:59.043487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:35:59.044360 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:35:59.065103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:59.065566 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:59.066360 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:35:59.066795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:35:59.100999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] [e218803b-6856-4257-89a8-6a2e16c4d566] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 55670. May 28 14:35:59.190484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:35:59.198883 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1242 microversion: 2.1 time: 0.159932 May 28 14:35:59.199451 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 669/1349] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:35:59 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:00.215419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0702c77d-fdde-4af4-ac05-ba25166bdf38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:00.216076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0702c77d-fdde-4af4-ac05-ba25166bdf38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:00.223720 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0702c77d-fdde-4af4-ac05-ba25166bdf38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:00.224201 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0702c77d-fdde-4af4-ac05-ba25166bdf38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:00.224974 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0702c77d-fdde-4af4-ac05-ba25166bdf38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:00.225417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0702c77d-fdde-4af4-ac05-ba25166bdf38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:00.500376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-0702c77d-fdde-4af4-ac05-ba25166bdf38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:00.510236 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0702c77d-fdde-4af4-ac05-ba25166bdf38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1298 microversion: 2.1 time: 0.298621 May 28 14:36:00.510824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 681/1350] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:00 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:01.535236 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d0b09d06-f546-4606-b7cd-147405aef7da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:01.536087 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d0b09d06-f546-4606-b7cd-147405aef7da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:01.545019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d0b09d06-f546-4606-b7cd-147405aef7da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:01.545497 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d0b09d06-f546-4606-b7cd-147405aef7da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:01.546336 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d0b09d06-f546-4606-b7cd-147405aef7da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:01.546785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d0b09d06-f546-4606-b7cd-147405aef7da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:01.791297 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d0b09d06-f546-4606-b7cd-147405aef7da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:01.805019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d0b09d06-f546-4606-b7cd-147405aef7da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.273292 May 28 14:36:01.805976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 670/1351] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:01 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:02.823218 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-67f01505-c9d7-4f99-8649-ee57ef463c89 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:02.823985 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-67f01505-c9d7-4f99-8649-ee57ef463c89 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:02.831534 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67f01505-c9d7-4f99-8649-ee57ef463c89 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:02.832020 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67f01505-c9d7-4f99-8649-ee57ef463c89 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:02.832825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67f01505-c9d7-4f99-8649-ee57ef463c89 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:02.833269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-67f01505-c9d7-4f99-8649-ee57ef463c89 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:03.035082 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-d18b6780-ba60-4339-ae39-6176ff02a467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c47c54c-f1cc-46f3-9e0f-5868ae50ba46", "tag": "c41d8419-2408-4487-95f1-5b6ce2ba8dab"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:03.039768 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:03.039768 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:36:03.046754 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-d18b6780-ba60-4339-ae39-6176ff02a467 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:03.047262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-d18b6780-ba60-4339-ae39-6176ff02a467 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:03.065289 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-d18b6780-ba60-4339-ae39-6176ff02a467 service nova] Creating event network-changed:c41d8419-2408-4487-95f1-5b6ce2ba8dab for instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 on hv-cinder-79128 May 28 14:36:03.075222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-d18b6780-ba60-4339-ae39-6176ff02a467 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045088 May 28 14:36:03.076121 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 671/1352] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:36:03.322101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-67f01505-c9d7-4f99-8649-ee57ef463c89 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:03.331066 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-67f01505-c9d7-4f99-8649-ee57ef463c89 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.511219 May 28 14:36:03.331349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 682/1353] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:02 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:04.348154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9c4a541f-a869-4e65-bca7-2779fc62846c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:04.348931 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9c4a541f-a869-4e65-bca7-2779fc62846c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:04.357331 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9c4a541f-a869-4e65-bca7-2779fc62846c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:04.357730 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9c4a541f-a869-4e65-bca7-2779fc62846c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:04.358509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9c4a541f-a869-4e65-bca7-2779fc62846c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:04.358956 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9c4a541f-a869-4e65-bca7-2779fc62846c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:04.559188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9c4a541f-a869-4e65-bca7-2779fc62846c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:04.567487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9c4a541f-a869-4e65-bca7-2779fc62846c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.223492 May 28 14:36:04.568089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 672/1354] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:04 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:05.584468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:05.585110 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:05.592365 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:05.592819 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:05.593582 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:05.594015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:05.942007 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:05.950100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.369575 May 28 14:36:05.950669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 683/1355] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:05 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:06.966157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:06.966783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:06.974239 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:06.979396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:06.979396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:06.979396 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:07.175786 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:07.184401 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.222043 May 28 14:36:07.184960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 673/1356] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:06 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:08.200249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-30efe93b-ab1c-4006-b94c-b059725734ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:08.200807 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-30efe93b-ab1c-4006-b94c-b059725734ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:08.207962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30efe93b-ab1c-4006-b94c-b059725734ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:08.208471 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30efe93b-ab1c-4006-b94c-b059725734ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:08.209248 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30efe93b-ab1c-4006-b94c-b059725734ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:08.209707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30efe93b-ab1c-4006-b94c-b059725734ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:08.402796 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-30efe93b-ab1c-4006-b94c-b059725734ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:08.411145 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-30efe93b-ab1c-4006-b94c-b059725734ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.214724 May 28 14:36:08.411732 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 684/1357] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:08 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:09.428635 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:09.429269 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:09.437222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:09.437680 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:09.438531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:09.439043 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:09.638334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:09.646495 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.221698 May 28 14:36:09.647067 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 674/1358] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:09 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:10.663733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2c8796da-2abb-4323-ba2b-a9aff2716219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:10.664331 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2c8796da-2abb-4323-ba2b-a9aff2716219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:10.672617 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2c8796da-2abb-4323-ba2b-a9aff2716219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:10.673080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2c8796da-2abb-4323-ba2b-a9aff2716219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:10.673880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2c8796da-2abb-4323-ba2b-a9aff2716219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:10.674656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2c8796da-2abb-4323-ba2b-a9aff2716219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:10.877588 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2c8796da-2abb-4323-ba2b-a9aff2716219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:10.886461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2c8796da-2abb-4323-ba2b-a9aff2716219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.226495 May 28 14:36:10.887067 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 685/1359] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:10 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:10.990251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-636d6317-d17d-4a5d-9c21-5757165f4ae3 req-7614cf75-70db-4984-837a-ec00d65b9aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c47c54c-f1cc-46f3-9e0f-5868ae50ba46", "name": "network-vif-plugged", "status": "completed", "tag": "c41d8419-2408-4487-95f1-5b6ce2ba8dab"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:10.991963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:10.991963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:36:11.000337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-636d6317-d17d-4a5d-9c21-5757165f4ae3 req-7614cf75-70db-4984-837a-ec00d65b9aa8 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:11.002032 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-636d6317-d17d-4a5d-9c21-5757165f4ae3 req-7614cf75-70db-4984-837a-ec00d65b9aa8 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:11.017073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-636d6317-d17d-4a5d-9c21-5757165f4ae3 req-7614cf75-70db-4984-837a-ec00d65b9aa8 service nova] Creating event network-vif-plugged:c41d8419-2408-4487-95f1-5b6ce2ba8dab for instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 on hv-cinder-79128 May 28 14:36:11.021793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-636d6317-d17d-4a5d-9c21-5757165f4ae3 req-7614cf75-70db-4984-837a-ec00d65b9aa8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 May 28 14:36:11.022367 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 675/1360] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:36:11.903413 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-023d51a0-b714-4e00-b79d-d8aeff83cc5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:11.904067 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-023d51a0-b714-4e00-b79d-d8aeff83cc5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:11.911299 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-023d51a0-b714-4e00-b79d-d8aeff83cc5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:11.911907 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-023d51a0-b714-4e00-b79d-d8aeff83cc5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:11.912694 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-023d51a0-b714-4e00-b79d-d8aeff83cc5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:11.913141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-023d51a0-b714-4e00-b79d-d8aeff83cc5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:12.107427 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-023d51a0-b714-4e00-b79d-d8aeff83cc5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:12.115495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-023d51a0-b714-4e00-b79d-d8aeff83cc5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1363 microversion: 2.1 time: 0.216336 May 28 14:36:12.116078 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 686/1361] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:11 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:13.133067 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6f3b06c1-218d-47c2-a2a4-18120db6b13f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:13.133686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6f3b06c1-218d-47c2-a2a4-18120db6b13f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:13.141628 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f3b06c1-218d-47c2-a2a4-18120db6b13f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:13.142077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f3b06c1-218d-47c2-a2a4-18120db6b13f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:13.142839 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f3b06c1-218d-47c2-a2a4-18120db6b13f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:13.143274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6f3b06c1-218d-47c2-a2a4-18120db6b13f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:13.432813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6f3b06c1-218d-47c2-a2a4-18120db6b13f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:13.441045 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6f3b06c1-218d-47c2-a2a4-18120db6b13f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1548 microversion: 2.1 time: 0.312231 May 28 14:36:13.441619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 676/1362] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:13 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1548 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:13.457478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:13.457998 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:13.465162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:13.465624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:13.466401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:13.466846 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:13.608934 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155079 May 28 14:36:13.609844 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 687/1363] 10.222.0.59 () {58 vars in 1275 bytes} [Fri May 28 14:36:13 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:36:15.342670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-3fdd248e-0db7-4743-b4fa-1ad145718b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c47c54c-f1cc-46f3-9e0f-5868ae50ba46", "tag": "c41d8419-2408-4487-95f1-5b6ce2ba8dab"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:15.345254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:15.345254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:36:15.346164 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a70dbf37-1123-4ca4-a5b7-82d4ccbe3cde tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:15.347167 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a70dbf37-1123-4ca4-a5b7-82d4ccbe3cde tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:15.354212 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-3fdd248e-0db7-4743-b4fa-1ad145718b7f service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:15.354670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-3fdd248e-0db7-4743-b4fa-1ad145718b7f service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:15.355494 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a70dbf37-1123-4ca4-a5b7-82d4ccbe3cde tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:15.356089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a70dbf37-1123-4ca4-a5b7-82d4ccbe3cde tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:15.357091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a70dbf37-1123-4ca4-a5b7-82d4ccbe3cde tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:15.357609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a70dbf37-1123-4ca4-a5b7-82d4ccbe3cde tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:15.371755 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-3fdd248e-0db7-4743-b4fa-1ad145718b7f service nova] Creating event network-changed:c41d8419-2408-4487-95f1-5b6ce2ba8dab for instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 on hv-cinder-79128 May 28 14:36:15.377335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-3fdd248e-0db7-4743-b4fa-1ad145718b7f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038339 May 28 14:36:15.378496 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 688/1364] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:36:15.456885 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a70dbf37-1123-4ca4-a5b7-82d4ccbe3cde tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.120056 May 28 14:36:15.460200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 677/1365] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:15 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:16.468933 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6e2f0fd6-7848-47fd-9382-46139f2a40a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:16.469969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6e2f0fd6-7848-47fd-9382-46139f2a40a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:16.477576 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6e2f0fd6-7848-47fd-9382-46139f2a40a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:16.478034 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6e2f0fd6-7848-47fd-9382-46139f2a40a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:16.478860 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6e2f0fd6-7848-47fd-9382-46139f2a40a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:16.479308 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6e2f0fd6-7848-47fd-9382-46139f2a40a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:16.573540 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6e2f0fd6-7848-47fd-9382-46139f2a40a4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.108612 May 28 14:36:16.574184 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 689/1366] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:16 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:17.585091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6d8c95c9-a3db-4d86-9da6-a28fbdff7fbf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:17.586077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6d8c95c9-a3db-4d86-9da6-a28fbdff7fbf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:17.594031 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6d8c95c9-a3db-4d86-9da6-a28fbdff7fbf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:17.594410 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6d8c95c9-a3db-4d86-9da6-a28fbdff7fbf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:17.595189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6d8c95c9-a3db-4d86-9da6-a28fbdff7fbf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:17.595654 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6d8c95c9-a3db-4d86-9da6-a28fbdff7fbf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:17.695790 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6d8c95c9-a3db-4d86-9da6-a28fbdff7fbf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.114667 May 28 14:36:17.696408 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 678/1367] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:17 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:18.707126 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e991d5ce-7c3a-416e-98f3-cdf12286548b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:18.708208 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e991d5ce-7c3a-416e-98f3-cdf12286548b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:18.716712 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e991d5ce-7c3a-416e-98f3-cdf12286548b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:18.717182 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e991d5ce-7c3a-416e-98f3-cdf12286548b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:18.717979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e991d5ce-7c3a-416e-98f3-cdf12286548b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:18.718430 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e991d5ce-7c3a-416e-98f3-cdf12286548b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:18.820815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e991d5ce-7c3a-416e-98f3-cdf12286548b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.117701 May 28 14:36:18.821652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 690/1368] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:18 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:19.832104 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8285ce43-1f1d-498a-8c04-4e6c2f21a83e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:19.833109 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8285ce43-1f1d-498a-8c04-4e6c2f21a83e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:19.841027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8285ce43-1f1d-498a-8c04-4e6c2f21a83e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:19.841487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8285ce43-1f1d-498a-8c04-4e6c2f21a83e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:19.842267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8285ce43-1f1d-498a-8c04-4e6c2f21a83e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:19.842704 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8285ce43-1f1d-498a-8c04-4e6c2f21a83e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:19.936507 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8285ce43-1f1d-498a-8c04-4e6c2f21a83e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.108457 May 28 14:36:19.937142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 679/1369] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:19 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:20.947578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0f5aae8f-48ec-42d9-999b-f16bf4625bfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:20.948634 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0f5aae8f-48ec-42d9-999b-f16bf4625bfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:20.956506 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0f5aae8f-48ec-42d9-999b-f16bf4625bfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:20.956966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0f5aae8f-48ec-42d9-999b-f16bf4625bfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:20.957739 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0f5aae8f-48ec-42d9-999b-f16bf4625bfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:20.958176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0f5aae8f-48ec-42d9-999b-f16bf4625bfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:21.049772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0f5aae8f-48ec-42d9-999b-f16bf4625bfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.106278 May 28 14:36:21.050389 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 691/1370] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:20 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:22.061925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8dea04ac-eb97-4292-ad42-7056ff266338 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:22.062935 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8dea04ac-eb97-4292-ad42-7056ff266338 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:22.070822 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8dea04ac-eb97-4292-ad42-7056ff266338 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:22.071279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8dea04ac-eb97-4292-ad42-7056ff266338 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:22.072084 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8dea04ac-eb97-4292-ad42-7056ff266338 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:22.072528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8dea04ac-eb97-4292-ad42-7056ff266338 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:22.170820 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8dea04ac-eb97-4292-ad42-7056ff266338 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.113470 May 28 14:36:22.171454 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 680/1371] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:22 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:23.182348 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0d9b633b-b232-4549-9bcc-67aea5e34535 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:23.183362 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0d9b633b-b232-4549-9bcc-67aea5e34535 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:23.191851 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0d9b633b-b232-4549-9bcc-67aea5e34535 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:23.192314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0d9b633b-b232-4549-9bcc-67aea5e34535 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:23.193102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0d9b633b-b232-4549-9bcc-67aea5e34535 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:23.193551 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0d9b633b-b232-4549-9bcc-67aea5e34535 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:23.296162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0d9b633b-b232-4549-9bcc-67aea5e34535 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.117867 May 28 14:36:23.296768 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 692/1372] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:23 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:24.307462 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-036f6f63-1fb4-4fd9-a7a8-02e1985fd455 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:24.308539 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-036f6f63-1fb4-4fd9-a7a8-02e1985fd455 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:24.316593 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-036f6f63-1fb4-4fd9-a7a8-02e1985fd455 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:24.317042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-036f6f63-1fb4-4fd9-a7a8-02e1985fd455 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:24.317806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-036f6f63-1fb4-4fd9-a7a8-02e1985fd455 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:24.318243 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-036f6f63-1fb4-4fd9-a7a8-02e1985fd455 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:24.421551 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-036f6f63-1fb4-4fd9-a7a8-02e1985fd455 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 14 microversion: 2.1 time: 0.117927 May 28 14:36:24.422170 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 681/1373] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:24 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:36:25.433041 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f9539721-8943-45ad-87b4-f4d5f0a9c2ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:25.434599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f9539721-8943-45ad-87b4-f4d5f0a9c2ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:25.442516 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9539721-8943-45ad-87b4-f4d5f0a9c2ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:25.442979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9539721-8943-45ad-87b4-f4d5f0a9c2ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:25.443792 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9539721-8943-45ad-87b4-f4d5f0a9c2ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:25.444244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f9539721-8943-45ad-87b4-f4d5f0a9c2ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:25.562541 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f9539721-8943-45ad-87b4-f4d5f0a9c2ce tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 6451 microversion: 2.1 time: 0.133598 May 28 14:36:25.563168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 693/1374] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:25 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 6451 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:26.575108 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-1d2d64b6-f9d9-457d-9625-d3bf6e1ec5d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:26.576128 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-1d2d64b6-f9d9-457d-9625-d3bf6e1ec5d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:26.583925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b6-f9d9-457d-9625-d3bf6e1ec5d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:26.584380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b6-f9d9-457d-9625-d3bf6e1ec5d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:26.585157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b6-f9d9-457d-9625-d3bf6e1ec5d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:26.585596 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b6-f9d9-457d-9625-d3bf6e1ec5d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:26.685861 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-1d2d64b6-f9d9-457d-9625-d3bf6e1ec5d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 15025 microversion: 2.1 time: 0.115693 May 28 14:36:26.686537 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 682/1375] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:26 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 15025 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:27.698377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-52626c5c-f63d-4603-97b1-e0ef154c3b1c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:27.699906 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-52626c5c-f63d-4603-97b1-e0ef154c3b1c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:27.707839 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-52626c5c-f63d-4603-97b1-e0ef154c3b1c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:27.708305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-52626c5c-f63d-4603-97b1-e0ef154c3b1c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:27.709092 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-52626c5c-f63d-4603-97b1-e0ef154c3b1c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:27.709542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-52626c5c-f63d-4603-97b1-e0ef154c3b1c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:27.807060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-52626c5c-f63d-4603-97b1-e0ef154c3b1c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 18449 microversion: 2.1 time: 0.112984 May 28 14:36:27.807768 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 694/1376] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:27 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 18449 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:28.818891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ff2171c6-dfdb-481d-89b1-c4ab3f5ae88f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:28.819972 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ff2171c6-dfdb-481d-89b1-c4ab3f5ae88f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:28.827963 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ff2171c6-dfdb-481d-89b1-c4ab3f5ae88f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:28.828422 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ff2171c6-dfdb-481d-89b1-c4ab3f5ae88f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:28.829208 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ff2171c6-dfdb-481d-89b1-c4ab3f5ae88f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:28.829653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ff2171c6-dfdb-481d-89b1-c4ab3f5ae88f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:28.926145 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ff2171c6-dfdb-481d-89b1-c4ab3f5ae88f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 19342 microversion: 2.1 time: 0.111283 May 28 14:36:28.926764 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 683/1377] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:28 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:29.938722 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b7e05198-7e6c-4b7f-a0c4-3fe5d543d143 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:29.939779 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b7e05198-7e6c-4b7f-a0c4-3fe5d543d143 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:29.947368 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b7e05198-7e6c-4b7f-a0c4-3fe5d543d143 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:29.947889 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b7e05198-7e6c-4b7f-a0c4-3fe5d543d143 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:29.948676 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b7e05198-7e6c-4b7f-a0c4-3fe5d543d143 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:29.949129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b7e05198-7e6c-4b7f-a0c4-3fe5d543d143 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:30.061330 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b7e05198-7e6c-4b7f-a0c4-3fe5d543d143 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 22167 microversion: 2.1 time: 0.126611 May 28 14:36:30.061969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 695/1378] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:29 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 22167 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:31.073535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7644946e-1cbb-4bb5-9694-4c33a404db0f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:31.075252 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7644946e-1cbb-4bb5-9694-4c33a404db0f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:31.083515 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7644946e-1cbb-4bb5-9694-4c33a404db0f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:31.084004 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7644946e-1cbb-4bb5-9694-4c33a404db0f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:31.084800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7644946e-1cbb-4bb5-9694-4c33a404db0f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:31.085247 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7644946e-1cbb-4bb5-9694-4c33a404db0f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:31.187750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7644946e-1cbb-4bb5-9694-4c33a404db0f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 23657 microversion: 2.1 time: 0.118399 May 28 14:36:31.188407 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 684/1379] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:31 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 23657 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:31.974111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-10df532a-0c1b-4853-95d6-580dae395e61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:31.974835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-10df532a-0c1b-4853-95d6-580dae395e61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:31.976995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-c7c208e4-a62c-4947-a398-2ebe5b70bd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53de36ab-8fe6-41ba-b6d2-785dadfa9989", "tag": "0c4d0a98-5c2e-401f-a013-9e7bf90a9c78"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:31.978452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:31.978452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:36:31.984013 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-10df532a-0c1b-4853-95d6-580dae395e61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:31.984669 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-10df532a-0c1b-4853-95d6-580dae395e61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:31.985648 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-10df532a-0c1b-4853-95d6-580dae395e61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:31.986172 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-10df532a-0c1b-4853-95d6-580dae395e61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:31.988978 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-c7c208e4-a62c-4947-a398-2ebe5b70bd80 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:31.993915 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-c7c208e4-a62c-4947-a398-2ebe5b70bd80 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:32.007458 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-c7c208e4-a62c-4947-a398-2ebe5b70bd80 service nova] Creating event network-changed:0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 for instance 53de36ab-8fe6-41ba-b6d2-785dadfa9989 on hv-cinder-79128 May 28 14:36:32.012197 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-c7c208e4-a62c-4947-a398-2ebe5b70bd80 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039095 May 28 14:36:32.013115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 685/1380] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:36:32.053143 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-10df532a-0c1b-4853-95d6-580dae395e61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:36:32.199465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d29e11ac-9811-4a8f-8c2f-5b4b948994bb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:32.201324 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d29e11ac-9811-4a8f-8c2f-5b4b948994bb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:32.209482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d29e11ac-9811-4a8f-8c2f-5b4b948994bb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:32.210044 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d29e11ac-9811-4a8f-8c2f-5b4b948994bb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:32.210938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d29e11ac-9811-4a8f-8c2f-5b4b948994bb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:32.211462 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d29e11ac-9811-4a8f-8c2f-5b4b948994bb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:32.313067 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d29e11ac-9811-4a8f-8c2f-5b4b948994bb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 25103 microversion: 2.1 time: 0.118160 May 28 14:36:32.313977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 686/1381] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:32 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 25103 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:36:32.387004 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-10df532a-0c1b-4853-95d6-580dae395e61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 204 len: 0 microversion: 2.1 time: 0.416235 May 28 14:36:32.387522 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 696/1382] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:36:31 2021] DELETE /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:36:32.396453 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:32.397183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:32.406420 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:32.407362 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:32.408484 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:32.409085 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:32.760442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:32.770065 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1580 microversion: 2.1 time: 0.377889 May 28 14:36:32.770853 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 687/1383] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:32 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1580 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:33.326271 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1622a96d-2b39-4984-8eb0-ec21008f6017 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:33.327214 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1622a96d-2b39-4984-8eb0-ec21008f6017 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:33.335891 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1622a96d-2b39-4984-8eb0-ec21008f6017 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:33.346181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1622a96d-2b39-4984-8eb0-ec21008f6017 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:33.346181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1622a96d-2b39-4984-8eb0-ec21008f6017 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:33.346181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1622a96d-2b39-4984-8eb0-ec21008f6017 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:33.434535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1622a96d-2b39-4984-8eb0-ec21008f6017 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 26287 microversion: 2.1 time: 0.113143 May 28 14:36:33.435178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 697/1384] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:33 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 26287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:33.787225 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:33.787873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:33.795464 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:33.799966 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:33.799966 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:33.799966 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:33.993141 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:34.002036 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1461 microversion: 2.1 time: 0.218504 May 28 14:36:34.002602 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 688/1385] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:33 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1461 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:34.446356 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0a9df7e8-0b3b-45b1-9ace-5b93d3b70f17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:34.447272 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-0a9df7e8-0b3b-45b1-9ace-5b93d3b70f17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:34.455153 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a9df7e8-0b3b-45b1-9ace-5b93d3b70f17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:34.455640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a9df7e8-0b3b-45b1-9ace-5b93d3b70f17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:34.456423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a9df7e8-0b3b-45b1-9ace-5b93d3b70f17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:34.456863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-0a9df7e8-0b3b-45b1-9ace-5b93d3b70f17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:34.556133 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0a9df7e8-0b3b-45b1-9ace-5b93d3b70f17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 27105 microversion: 2.1 time: 0.113906 May 28 14:36:34.560494 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 698/1386] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:34 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 27105 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:35.019509 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:35.020081 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:35.027590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:35.028200 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:35.028999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:35.029470 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:35.231319 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:35.239577 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1461 microversion: 2.1 time: 0.223940 May 28 14:36:35.240158 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 689/1387] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:35 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1461 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:35.411488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-d1e6277d-bf53-4bb3-9ad8-9b2d4b3ff381 req-5d5ab106-569d-4d05-884e-d2b8c358dd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53de36ab-8fe6-41ba-b6d2-785dadfa9989", "name": "network-vif-deleted", "tag": "0c4d0a98-5c2e-401f-a013-9e7bf90a9c78"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:35.412958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:35.412958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:36:35.422598 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-d1e6277d-bf53-4bb3-9ad8-9b2d4b3ff381 req-5d5ab106-569d-4d05-884e-d2b8c358dd11 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:35.423047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-d1e6277d-bf53-4bb3-9ad8-9b2d4b3ff381 req-5d5ab106-569d-4d05-884e-d2b8c358dd11 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:35.438560 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-d1e6277d-bf53-4bb3-9ad8-9b2d4b3ff381 req-5d5ab106-569d-4d05-884e-d2b8c358dd11 service nova] Creating event network-vif-deleted:0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 for instance 53de36ab-8fe6-41ba-b6d2-785dadfa9989 on hv-cinder-79128 May 28 14:36:35.443230 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-d1e6277d-bf53-4bb3-9ad8-9b2d4b3ff381 req-5d5ab106-569d-4d05-884e-d2b8c358dd11 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 May 28 14:36:35.444017 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 699/1388] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:36:35.568391 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0eeb008c-3fec-4f4f-9990-404d4d665773 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:35.569229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0eeb008c-3fec-4f4f-9990-404d4d665773 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:35.577080 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0eeb008c-3fec-4f4f-9990-404d4d665773 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:35.577588 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0eeb008c-3fec-4f4f-9990-404d4d665773 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:35.578358 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0eeb008c-3fec-4f4f-9990-404d4d665773 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:35.582231 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0eeb008c-3fec-4f4f-9990-404d4d665773 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:35.679197 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0eeb008c-3fec-4f4f-9990-404d4d665773 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 27681 microversion: 2.1 time: 0.114525 May 28 14:36:35.681322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 690/1389] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:35 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 27681 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:36.257453 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:36.258085 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:36.266476 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:36.266939 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:36.267787 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:36.268237 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:36.338678 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:36.339774 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:36.340238 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lazy-loading 'fault' on Instance uuid 53de36ab-8fe6-41ba-b6d2-785dadfa9989 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:36:36.520297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:36.529572 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 200 len: 1231 microversion: 2.1 time: 0.276426 May 28 14:36:36.530142 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 700/1390] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:36 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 1231 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:36.691415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-915bc2a0-cbff-4d15-a9e8-9879d2f881ad tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:36.692483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-915bc2a0-cbff-4d15-a9e8-9879d2f881ad tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:36.701209 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-915bc2a0-cbff-4d15-a9e8-9879d2f881ad tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:36.702864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-915bc2a0-cbff-4d15-a9e8-9879d2f881ad tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:36.702864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-915bc2a0-cbff-4d15-a9e8-9879d2f881ad tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:36.703041 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-915bc2a0-cbff-4d15-a9e8-9879d2f881ad tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:36.804025 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-915bc2a0-cbff-4d15-a9e8-9879d2f881ad tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28043 microversion: 2.1 time: 0.116556 May 28 14:36:36.804592 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 691/1391] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:36 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28043 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:36:37.547220 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:37.548032 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 53de36ab-8fe6-41ba-b6d2-785dadfa9989] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:37.556602 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:37.557090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:37.557950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:37.558762 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:37.610782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] HTTP exception thrown: Instance 53de36ab-8fe6-41ba-b6d2-785dadfa9989 could not be found. May 28 14:36:37.611421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Returning 404 to user: Instance 53de36ab-8fe6-41ba-b6d2-785dadfa9989 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:36:37.612315 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2a9a459b-6b3d-42ac-ae51-0d4b16d2bb16 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989" status: 404 len: 111 microversion: 2.1 time: 0.068912 May 28 14:36:37.612900 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 701/1392] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:37 2021] GET /compute/v2.1/servers/53de36ab-8fe6-41ba-b6d2-785dadfa9989 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:36:37.817572 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8a6e090b-4ff7-4a1e-8128-5a80ae583d96 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:37.818623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8a6e090b-4ff7-4a1e-8128-5a80ae583d96 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:37.827289 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8a6e090b-4ff7-4a1e-8128-5a80ae583d96 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:37.827859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8a6e090b-4ff7-4a1e-8128-5a80ae583d96 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:37.828658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8a6e090b-4ff7-4a1e-8128-5a80ae583d96 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:37.829101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8a6e090b-4ff7-4a1e-8128-5a80ae583d96 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:37.932540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8a6e090b-4ff7-4a1e-8128-5a80ae583d96 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.119170 May 28 14:36:37.937243 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 692/1393] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:37 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:38.944490 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c2e5eb53-23b2-4a56-bf9b-50d8e7882125 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:38.945608 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c2e5eb53-23b2-4a56-bf9b-50d8e7882125 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:38.953337 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c2e5eb53-23b2-4a56-bf9b-50d8e7882125 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:38.953794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c2e5eb53-23b2-4a56-bf9b-50d8e7882125 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:38.954650 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c2e5eb53-23b2-4a56-bf9b-50d8e7882125 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:38.955095 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c2e5eb53-23b2-4a56-bf9b-50d8e7882125 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:39.061473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c2e5eb53-23b2-4a56-bf9b-50d8e7882125 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.120466 May 28 14:36:39.062035 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 702/1394] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:38 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:40.073929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a88abd81-e7bf-4f53-8855-ed2bb3ee81db tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:40.074932 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a88abd81-e7bf-4f53-8855-ed2bb3ee81db tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:40.082891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a88abd81-e7bf-4f53-8855-ed2bb3ee81db tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:40.083346 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a88abd81-e7bf-4f53-8855-ed2bb3ee81db tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:40.084156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a88abd81-e7bf-4f53-8855-ed2bb3ee81db tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:40.084596 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a88abd81-e7bf-4f53-8855-ed2bb3ee81db tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:40.184695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a88abd81-e7bf-4f53-8855-ed2bb3ee81db tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.114823 May 28 14:36:40.185358 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 693/1395] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:40 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:41.196958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-565d6d3c-f0a9-4be5-961e-abedbdd32da6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:41.198097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-565d6d3c-f0a9-4be5-961e-abedbdd32da6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:41.206723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-565d6d3c-f0a9-4be5-961e-abedbdd32da6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:41.207178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-565d6d3c-f0a9-4be5-961e-abedbdd32da6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:41.207996 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-565d6d3c-f0a9-4be5-961e-abedbdd32da6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:41.208435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-565d6d3c-f0a9-4be5-961e-abedbdd32da6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:41.307334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-565d6d3c-f0a9-4be5-961e-abedbdd32da6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.114336 May 28 14:36:41.308557 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 703/1396] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:41 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:41.860776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9eee4d84-175c-421b-b3ad-514582db4550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:41.861368 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9eee4d84-175c-421b-b3ad-514582db4550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:41.862873 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-0c4978e9-1c8c-40fc-acfd-cd5d7a55e765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44daf467-480b-40ee-8e1b-567ea8d285ee", "tag": "a1d19f37-64ae-4f18-a8f2-79559df44a3b"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:41.864668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:41.864668 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:36:41.870844 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9eee4d84-175c-421b-b3ad-514582db4550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:41.871298 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9eee4d84-175c-421b-b3ad-514582db4550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:41.872121 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9eee4d84-175c-421b-b3ad-514582db4550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:41.872565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9eee4d84-175c-421b-b3ad-514582db4550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:41.875092 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-0c4978e9-1c8c-40fc-acfd-cd5d7a55e765 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:41.875658 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-0c4978e9-1c8c-40fc-acfd-cd5d7a55e765 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:41.891686 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-0c4978e9-1c8c-40fc-acfd-cd5d7a55e765 service nova] Creating event network-changed:a1d19f37-64ae-4f18-a8f2-79559df44a3b for instance 44daf467-480b-40ee-8e1b-567ea8d285ee on hv-cinder-79128 May 28 14:36:41.896466 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-0c4978e9-1c8c-40fc-acfd-cd5d7a55e765 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037939 May 28 14:36:41.897146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 704/1397] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:36:41.935279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9eee4d84-175c-421b-b3ad-514582db4550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:36:42.261185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9eee4d84-175c-421b-b3ad-514582db4550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 204 len: 0 microversion: 2.1 time: 0.403770 May 28 14:36:42.265105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 694/1398] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:36:41 2021] DELETE /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:36:42.271393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:42.274554 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:42.283666 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:42.284371 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:42.285179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:42.285624 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:42.320922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7230f11b-f418-40a2-9cec-98a52ac6ace3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:42.322426 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7230f11b-f418-40a2-9cec-98a52ac6ace3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:42.331178 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7230f11b-f418-40a2-9cec-98a52ac6ace3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:42.334443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7230f11b-f418-40a2-9cec-98a52ac6ace3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:42.334443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7230f11b-f418-40a2-9cec-98a52ac6ace3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:42.334443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7230f11b-f418-40a2-9cec-98a52ac6ace3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:42.435388 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7230f11b-f418-40a2-9cec-98a52ac6ace3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.118655 May 28 14:36:42.436816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 695/1399] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:42 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:42.572491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:42.581833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1577 microversion: 2.1 time: 0.314699 May 28 14:36:42.583190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 705/1400] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:42 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1577 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:36:43.448270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cb359f69-0f64-4a35-ad2c-ad2aa5b2e526 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:43.449282 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cb359f69-0f64-4a35-ad2c-ad2aa5b2e526 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:43.457243 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cb359f69-0f64-4a35-ad2c-ad2aa5b2e526 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:43.457642 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cb359f69-0f64-4a35-ad2c-ad2aa5b2e526 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:43.458428 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cb359f69-0f64-4a35-ad2c-ad2aa5b2e526 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:43.458871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cb359f69-0f64-4a35-ad2c-ad2aa5b2e526 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:43.554492 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cb359f69-0f64-4a35-ad2c-ad2aa5b2e526 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.110371 May 28 14:36:43.555147 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 696/1401] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:43 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:43.601299 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e7d1a728-fa2b-4902-be9a-6e0cccced08f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:43.601983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e7d1a728-fa2b-4902-be9a-6e0cccced08f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:43.610998 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7d1a728-fa2b-4902-be9a-6e0cccced08f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:43.611464 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7d1a728-fa2b-4902-be9a-6e0cccced08f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:43.612298 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7d1a728-fa2b-4902-be9a-6e0cccced08f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:43.612774 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e7d1a728-fa2b-4902-be9a-6e0cccced08f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:43.883423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e7d1a728-fa2b-4902-be9a-6e0cccced08f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:43.892314 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e7d1a728-fa2b-4902-be9a-6e0cccced08f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1459 microversion: 2.1 time: 0.295914 May 28 14:36:43.892886 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 706/1402] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:43 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1459 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:44.108226 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-d3895cc7-74aa-4ae0-8bfe-c74d016085f3 req-21e0e9ed-74ac-493b-be85-a6ecf8b5596a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44daf467-480b-40ee-8e1b-567ea8d285ee", "name": "network-vif-deleted", "tag": "a1d19f37-64ae-4f18-a8f2-79559df44a3b"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:44.109714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:44.109714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:36:44.119745 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-d3895cc7-74aa-4ae0-8bfe-c74d016085f3 req-21e0e9ed-74ac-493b-be85-a6ecf8b5596a service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:44.120677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-d3895cc7-74aa-4ae0-8bfe-c74d016085f3 req-21e0e9ed-74ac-493b-be85-a6ecf8b5596a service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:44.138116 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-d3895cc7-74aa-4ae0-8bfe-c74d016085f3 req-21e0e9ed-74ac-493b-be85-a6ecf8b5596a service nova] Creating event network-vif-deleted:a1d19f37-64ae-4f18-a8f2-79559df44a3b for instance 44daf467-480b-40ee-8e1b-567ea8d285ee on hv-cinder-79128 May 28 14:36:44.143192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-d3895cc7-74aa-4ae0-8bfe-c74d016085f3 req-21e0e9ed-74ac-493b-be85-a6ecf8b5596a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038944 May 28 14:36:44.143809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 697/1403] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:36:44.566264 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7533b726-58ef-44d3-9c0c-3f8aba35c4f9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:44.567234 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7533b726-58ef-44d3-9c0c-3f8aba35c4f9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:44.574382 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7533b726-58ef-44d3-9c0c-3f8aba35c4f9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:44.582530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7533b726-58ef-44d3-9c0c-3f8aba35c4f9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:44.582530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7533b726-58ef-44d3-9c0c-3f8aba35c4f9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:44.582530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7533b726-58ef-44d3-9c0c-3f8aba35c4f9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:44.678834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7533b726-58ef-44d3-9c0c-3f8aba35c4f9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.116124 May 28 14:36:44.679521 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 707/1404] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:44 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:44.910393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:44.911028 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:44.919197 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:44.919683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:44.920469 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:44.920917 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:44.989345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:44.989806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:44.990264 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.objects.instance [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lazy-loading 'fault' on Instance uuid 44daf467-480b-40ee-8e1b-567ea8d285ee {{(pid=106812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:36:45.131221 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fb81f5f54947be9db03d07ad8d6ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:45.140553 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-535212c4-9871-4cb0-9373-df8eaf407f66 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 200 len: 1230 microversion: 2.1 time: 0.234403 May 28 14:36:45.141126 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 698/1405] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:44 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 1230 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:45.691873 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cd2b8126-9080-460e-854b-a799f0ae5e9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:45.692883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cd2b8126-9080-460e-854b-a799f0ae5e9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:45.700799 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd2b8126-9080-460e-854b-a799f0ae5e9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:45.701258 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd2b8126-9080-460e-854b-a799f0ae5e9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:45.702045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd2b8126-9080-460e-854b-a799f0ae5e9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:45.702510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd2b8126-9080-460e-854b-a799f0ae5e9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:45.797942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cd2b8126-9080-460e-854b-a799f0ae5e9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.110050 May 28 14:36:45.798489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 708/1406] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:45 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:46.158422 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:46.158964 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 44daf467-480b-40ee-8e1b-567ea8d285ee] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:46.166062 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:46.166517 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:46.167299 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:46.167778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:46.217453 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] HTTP exception thrown: Instance 44daf467-480b-40ee-8e1b-567ea8d285ee could not be found. May 28 14:36:46.218067 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Returning 404 to user: Instance 44daf467-480b-40ee-8e1b-567ea8d285ee could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:36:46.218910 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a017499f-3969-4c7c-8d6e-207a6cfc85b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee" status: 404 len: 111 microversion: 2.1 time: 0.064732 May 28 14:36:46.219475 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 699/1407] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:46 2021] GET /compute/v2.1/servers/44daf467-480b-40ee-8e1b-567ea8d285ee => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:36:46.810784 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4e076ede-620f-4209-9b05-b9eb7f6a0240 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:46.812264 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4e076ede-620f-4209-9b05-b9eb7f6a0240 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:46.820758 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e076ede-620f-4209-9b05-b9eb7f6a0240 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:46.823783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e076ede-620f-4209-9b05-b9eb7f6a0240 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:46.823783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e076ede-620f-4209-9b05-b9eb7f6a0240 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:46.823783 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e076ede-620f-4209-9b05-b9eb7f6a0240 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:46.924169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4e076ede-620f-4209-9b05-b9eb7f6a0240 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.118056 May 28 14:36:46.924834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 709/1408] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:46 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:47.176912 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:47.177425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:47.185752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:47.186209 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:47.186988 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:47.187437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:47.237711 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] HTTP exception thrown: Instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 could not be found. May 28 14:36:47.238325 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Returning 404 to user: Instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:36:47.239168 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c513554d-bb79-4c5f-a26a-528fb8ff35c9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 404 len: 111 microversion: 2.1 time: 0.066045 May 28 14:36:47.239754 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 700/1409] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:36:47 2021] DELETE /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:36:47.249202 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:47.249927 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] [instance: 2be0a35c-b0fe-4a26-b785-3e16aa182171] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:47.257829 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:47.258277 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:47.259044 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:47.259488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:47.307410 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] HTTP exception thrown: Instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 could not be found. May 28 14:36:47.308100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Returning 404 to user: Instance 2be0a35c-b0fe-4a26-b785-3e16aa182171 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:36:47.309407 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-33061f5e-8b50-4054-a640-467ca7b1794a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171" status: 404 len: 111 microversion: 2.1 time: 0.064379 May 28 14:36:47.309937 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 710/1410] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:47 2021] GET /compute/v2.1/servers/2be0a35c-b0fe-4a26-b785-3e16aa182171 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:36:47.936064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2acf9eb2-680f-4791-a514-aa9f5632806f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:47.937013 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2acf9eb2-680f-4791-a514-aa9f5632806f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:47.944287 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2acf9eb2-680f-4791-a514-aa9f5632806f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:47.944745 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2acf9eb2-680f-4791-a514-aa9f5632806f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:47.945520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2acf9eb2-680f-4791-a514-aa9f5632806f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:47.945991 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2acf9eb2-680f-4791-a514-aa9f5632806f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:48.038806 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2acf9eb2-680f-4791-a514-aa9f5632806f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.106562 May 28 14:36:48.039436 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 701/1411] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:47 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:49.015436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-60a0a75c-6243-43f9-bf7f-fb30067c6ba4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling method '.version_select at 0x7f2aaed72e50>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:49.050770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-69f1cb1c-a009-4962-870f-c98270f5c9a1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:49.051808 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-69f1cb1c-a009-4962-870f-c98270f5c9a1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:49.059791 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-69f1cb1c-a009-4962-870f-c98270f5c9a1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:49.060255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-69f1cb1c-a009-4962-870f-c98270f5c9a1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:49.061027 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-69f1cb1c-a009-4962-870f-c98270f5c9a1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:49.061471 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-69f1cb1c-a009-4962-870f-c98270f5c9a1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:49.083780 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-60a0a75c-6243-43f9-bf7f-fb30067c6ba4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1591401235" status: 202 len: 0 microversion: 2.1 time: 0.072463 May 28 14:36:49.084393 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 711/1412] 10.222.0.59 () {58 vars in 1263 bytes} [Fri May 28 14:36:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1591401235 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:36:49.164251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-69f1cb1c-a009-4962-870f-c98270f5c9a1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.117204 May 28 14:36:49.168283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 702/1413] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:49 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:36:50.176925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-cd3371ac-1f3f-4bcd-af56-6b59f58a5008 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:50.178470 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-cd3371ac-1f3f-4bcd-af56-6b59f58a5008 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:50.187343 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd3371ac-1f3f-4bcd-af56-6b59f58a5008 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:50.187781 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd3371ac-1f3f-4bcd-af56-6b59f58a5008 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:50.188574 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd3371ac-1f3f-4bcd-af56-6b59f58a5008 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:50.189013 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-cd3371ac-1f3f-4bcd-af56-6b59f58a5008 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:50.286387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-cd3371ac-1f3f-4bcd-af56-6b59f58a5008 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.113607 May 28 14:36:50.287926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 712/1414] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:50 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:51.299500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a5ce8dd6-a5ed-41ca-83e8-27137730ff19 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:51.300728 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a5ce8dd6-a5ed-41ca-83e8-27137730ff19 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:51.309479 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5ce8dd6-a5ed-41ca-83e8-27137730ff19 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:51.310047 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5ce8dd6-a5ed-41ca-83e8-27137730ff19 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:51.310928 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5ce8dd6-a5ed-41ca-83e8-27137730ff19 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:51.311461 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a5ce8dd6-a5ed-41ca-83e8-27137730ff19 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:51.410584 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a5ce8dd6-a5ed-41ca-83e8-27137730ff19 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28227 microversion: 2.1 time: 0.115034 May 28 14:36:51.414374 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 703/1415] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:51 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28227 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:51.681544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:51.682709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:51.693534 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:51.694195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:51.695171 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:51.695813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:51.748610 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-3b503bd1-e885-420c-88ca-db9c98203248 req-50169668-2ecb-4d5e-ae65-14c72067842c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2477e125-22c2-4367-b28c-0aaf5754b37c", "tag": "e27f7a0e-7e77-4d61-a393-fe4fde4153d5"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:51.750423 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:51.750423 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:36:51.766154 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:36:51.774116 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-3b503bd1-e885-420c-88ca-db9c98203248 req-50169668-2ecb-4d5e-ae65-14c72067842c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:51.785816 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-3b503bd1-e885-420c-88ca-db9c98203248 req-50169668-2ecb-4d5e-ae65-14c72067842c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:51.818766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-3b503bd1-e885-420c-88ca-db9c98203248 req-50169668-2ecb-4d5e-ae65-14c72067842c service nova] Creating event network-changed:e27f7a0e-7e77-4d61-a393-fe4fde4153d5 for instance 2477e125-22c2-4367-b28c-0aaf5754b37c on hv-cinder-79128 May 28 14:36:51.823686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-3b503bd1-e885-420c-88ca-db9c98203248 req-50169668-2ecb-4d5e-ae65-14c72067842c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143663 May 28 14:36:51.825349 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 704/1416] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:36:52.088932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 204 len: 0 microversion: 2.1 time: 0.411278 May 28 14:36:52.097518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 713/1417] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:36:51 2021] DELETE /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:36:52.099951 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fa000912-f26a-41f2-a154-2a87af31673c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:52.100946 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fa000912-f26a-41f2-a154-2a87af31673c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:52.110746 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fa000912-f26a-41f2-a154-2a87af31673c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:52.111540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fa000912-f26a-41f2-a154-2a87af31673c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:52.112597 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fa000912-f26a-41f2-a154-2a87af31673c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:52.113337 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fa000912-f26a-41f2-a154-2a87af31673c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:52.340465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-fa000912-f26a-41f2-a154-2a87af31673c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:52.351426 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fa000912-f26a-41f2-a154-2a87af31673c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1567 microversion: 2.1 time: 0.255931 May 28 14:36:52.356288 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 705/1418] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:52 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:52.424835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4865461a-f969-49c6-9585-9c0567e8aa7d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:52.425923 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4865461a-f969-49c6-9585-9c0567e8aa7d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:52.435019 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4865461a-f969-49c6-9585-9c0567e8aa7d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:52.436772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4865461a-f969-49c6-9585-9c0567e8aa7d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:52.436772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4865461a-f969-49c6-9585-9c0567e8aa7d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:52.437015 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4865461a-f969-49c6-9585-9c0567e8aa7d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:52.581197 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4865461a-f969-49c6-9585-9c0567e8aa7d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28259 microversion: 2.1 time: 0.161581 May 28 14:36:52.590216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 714/1419] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:52 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:53.369796 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7f2ccb37-4fea-4264-8885-7933ffb43d32 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:53.370508 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7f2ccb37-4fea-4264-8885-7933ffb43d32 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:53.378845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f2ccb37-4fea-4264-8885-7933ffb43d32 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:53.379385 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f2ccb37-4fea-4264-8885-7933ffb43d32 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:53.380266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f2ccb37-4fea-4264-8885-7933ffb43d32 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:53.381157 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7f2ccb37-4fea-4264-8885-7933ffb43d32 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:53.596940 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9dad8d29-a95c-435e-90cd-eddbfde2cd73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:53.599122 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9dad8d29-a95c-435e-90cd-eddbfde2cd73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:53.608839 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9dad8d29-a95c-435e-90cd-eddbfde2cd73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:53.609415 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9dad8d29-a95c-435e-90cd-eddbfde2cd73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:53.610477 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9dad8d29-a95c-435e-90cd-eddbfde2cd73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:53.610610 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9dad8d29-a95c-435e-90cd-eddbfde2cd73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:53.700859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7f2ccb37-4fea-4264-8885-7933ffb43d32 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:53.709290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7f2ccb37-4fea-4264-8885-7933ffb43d32 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1448 microversion: 2.1 time: 0.343510 May 28 14:36:53.709858 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 706/1420] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:53 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1448 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:53.815080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9dad8d29-a95c-435e-90cd-eddbfde2cd73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28518 microversion: 2.1 time: 0.224436 May 28 14:36:53.819140 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 715/1421] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:53 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:54.726389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-da680d8c-6e80-41ff-a90d-8ec4226d803e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:54.727288 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-da680d8c-6e80-41ff-a90d-8ec4226d803e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:54.734796 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-da680d8c-6e80-41ff-a90d-8ec4226d803e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:54.735252 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-da680d8c-6e80-41ff-a90d-8ec4226d803e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:54.736064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-da680d8c-6e80-41ff-a90d-8ec4226d803e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:54.736505 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-da680d8c-6e80-41ff-a90d-8ec4226d803e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:54.833813 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f0000777-4a08-4ccd-b989-c82786588bfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:54.835055 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f0000777-4a08-4ccd-b989-c82786588bfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:54.851083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0000777-4a08-4ccd-b989-c82786588bfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:54.851454 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0000777-4a08-4ccd-b989-c82786588bfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:54.852274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0000777-4a08-4ccd-b989-c82786588bfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:54.859832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f0000777-4a08-4ccd-b989-c82786588bfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:54.970510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f0000777-4a08-4ccd-b989-c82786588bfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28671 microversion: 2.1 time: 0.144139 May 28 14:36:54.971658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-da680d8c-6e80-41ff-a90d-8ec4226d803e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:54.976345 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 716/1422] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:54 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:54.981460 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-da680d8c-6e80-41ff-a90d-8ec4226d803e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1448 microversion: 2.1 time: 0.258798 May 28 14:36:54.982114 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 707/1423] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:54 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1448 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:36:55.687548 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-dc0ff3b7-e355-4012-b73e-afedba2d894f req-1084bbea-4d77-41f8-940c-9b9be1a7e489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2477e125-22c2-4367-b28c-0aaf5754b37c", "name": "network-vif-deleted", "tag": "e27f7a0e-7e77-4d61-a393-fe4fde4153d5"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:55.689050 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:36:55.689050 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:36:55.704006 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-dc0ff3b7-e355-4012-b73e-afedba2d894f req-1084bbea-4d77-41f8-940c-9b9be1a7e489 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:55.704237 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-dc0ff3b7-e355-4012-b73e-afedba2d894f req-1084bbea-4d77-41f8-940c-9b9be1a7e489 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:55.721200 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-dc0ff3b7-e355-4012-b73e-afedba2d894f req-1084bbea-4d77-41f8-940c-9b9be1a7e489 service nova] Creating event network-vif-deleted:e27f7a0e-7e77-4d61-a393-fe4fde4153d5 for instance 2477e125-22c2-4367-b28c-0aaf5754b37c on hv-cinder-79128 May 28 14:36:55.725911 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-dc0ff3b7-e355-4012-b73e-afedba2d894f req-1084bbea-4d77-41f8-940c-9b9be1a7e489 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 May 28 14:36:55.726848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 717/1424] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:36:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:36:55.982940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c5be423f-b2a5-4efa-a5e4-8a5a379b7b3a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:55.984529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c5be423f-b2a5-4efa-a5e4-8a5a379b7b3a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:55.992661 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5be423f-b2a5-4efa-a5e4-8a5a379b7b3a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:55.993175 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5be423f-b2a5-4efa-a5e4-8a5a379b7b3a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:55.994229 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5be423f-b2a5-4efa-a5e4-8a5a379b7b3a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:55.994851 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c5be423f-b2a5-4efa-a5e4-8a5a379b7b3a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:55.999515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:56.000364 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:56.008590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:56.009305 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:56.010344 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:56.011010 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:56.110633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c5be423f-b2a5-4efa-a5e4-8a5a379b7b3a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.131605 May 28 14:36:56.114185 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 708/1425] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:55 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:56.436098 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97d344e60d043dda3c4762eb75e08a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:36:56.445756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 200 len: 1219 microversion: 2.1 time: 0.450718 May 28 14:36:56.446324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 718/1426] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:55 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 1219 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:36:57.124505 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-efc51d73-f99a-4c58-8d35-3f712ab89300 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:57.125685 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-efc51d73-f99a-4c58-8d35-3f712ab89300 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:57.134483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-efc51d73-f99a-4c58-8d35-3f712ab89300 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:57.134941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-efc51d73-f99a-4c58-8d35-3f712ab89300 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:57.135782 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-efc51d73-f99a-4c58-8d35-3f712ab89300 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:57.136228 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-efc51d73-f99a-4c58-8d35-3f712ab89300 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:57.235803 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-efc51d73-f99a-4c58-8d35-3f712ab89300 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.116688 May 28 14:36:57.236611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 709/1427] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:57 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:57.462542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:57.463219 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] [instance: 2477e125-22c2-4367-b28c-0aaf5754b37c] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:57.471017 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:57.471480 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:57.472297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:57.472743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:57.522121 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] HTTP exception thrown: Instance 2477e125-22c2-4367-b28c-0aaf5754b37c could not be found. May 28 14:36:57.522743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Returning 404 to user: Instance 2477e125-22c2-4367-b28c-0aaf5754b37c could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:36:57.523619 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3b406a09-208b-4997-b6ca-64a357eea901 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c" status: 404 len: 111 microversion: 2.1 time: 0.064951 May 28 14:36:57.524189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 719/1428] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:36:57 2021] GET /compute/v2.1/servers/2477e125-22c2-4367-b28c-0aaf5754b37c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:36:57.869301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-828fc745-d747-4345-9ab5-50595d4b19da tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling method '.version_select at 0x7f2aaddf2e50>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:36:57.981259 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-828fc745-d747-4345-9ab5-50595d4b19da tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2034719293" status: 202 len: 0 microversion: 2.1 time: 0.116413 May 28 14:36:57.981882 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 710/1429] 10.222.0.59 () {58 vars in 1254 bytes} [Fri May 28 14:36:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2034719293 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:36:58.249244 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-070eb7b2-d937-4677-bcdb-19b268c90a57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:58.250611 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-070eb7b2-d937-4677-bcdb-19b268c90a57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:58.258259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-070eb7b2-d937-4677-bcdb-19b268c90a57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:58.258884 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-070eb7b2-d937-4677-bcdb-19b268c90a57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:58.259814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-070eb7b2-d937-4677-bcdb-19b268c90a57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:58.266861 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-070eb7b2-d937-4677-bcdb-19b268c90a57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:58.386496 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-070eb7b2-d937-4677-bcdb-19b268c90a57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.141748 May 28 14:36:58.388476 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 720/1430] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:58 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:36:59.399472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6c609ef1-1d00-41cd-a9e8-fae6eb34b59b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:36:59.401220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6c609ef1-1d00-41cd-a9e8-fae6eb34b59b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:36:59.412258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6c609ef1-1d00-41cd-a9e8-fae6eb34b59b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:59.413107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6c609ef1-1d00-41cd-a9e8-fae6eb34b59b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:59.414115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6c609ef1-1d00-41cd-a9e8-fae6eb34b59b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:36:59.414733 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6c609ef1-1d00-41cd-a9e8-fae6eb34b59b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:36:59.517465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6c609ef1-1d00-41cd-a9e8-fae6eb34b59b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.121820 May 28 14:36:59.519014 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 711/1431] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:36:59 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:00.532045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1a8defe1-5061-4e80-82fa-1f91eef4c846 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:00.533374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1a8defe1-5061-4e80-82fa-1f91eef4c846 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:00.542656 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a8defe1-5061-4e80-82fa-1f91eef4c846 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:00.543090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a8defe1-5061-4e80-82fa-1f91eef4c846 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:00.544268 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a8defe1-5061-4e80-82fa-1f91eef4c846 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:00.544937 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a8defe1-5061-4e80-82fa-1f91eef4c846 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:00.643428 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1a8defe1-5061-4e80-82fa-1f91eef4c846 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.116973 May 28 14:37:00.647928 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 721/1432] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:00 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:01.656206 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-080e32f0-ab0a-4937-bd80-f7d6b613c654 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:01.658793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-080e32f0-ab0a-4937-bd80-f7d6b613c654 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:01.671450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-080e32f0-ab0a-4937-bd80-f7d6b613c654 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:01.672389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-080e32f0-ab0a-4937-bd80-f7d6b613c654 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:01.673660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-080e32f0-ab0a-4937-bd80-f7d6b613c654 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:01.674954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-080e32f0-ab0a-4937-bd80-f7d6b613c654 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:01.835418 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-080e32f0-ab0a-4937-bd80-f7d6b613c654 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.183807 May 28 14:37:01.841140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 712/1433] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:01 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:02.849131 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-eb832831-21a0-4791-805b-6bdf942df802 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:02.850355 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-eb832831-21a0-4791-805b-6bdf942df802 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:02.859099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eb832831-21a0-4791-805b-6bdf942df802 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:02.859593 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eb832831-21a0-4791-805b-6bdf942df802 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:02.860441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eb832831-21a0-4791-805b-6bdf942df802 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:02.860898 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eb832831-21a0-4791-805b-6bdf942df802 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:02.962917 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-eb832831-21a0-4791-805b-6bdf942df802 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.117913 May 28 14:37:02.963848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 722/1434] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:02 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:03.983010 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7ba4d5e1-55e0-484b-b4b0-ff91ce7a02c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:03.999104 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7ba4d5e1-55e0-484b-b4b0-ff91ce7a02c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:04.007432 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ba4d5e1-55e0-484b-b4b0-ff91ce7a02c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:04.007923 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ba4d5e1-55e0-484b-b4b0-ff91ce7a02c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:04.008726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ba4d5e1-55e0-484b-b4b0-ff91ce7a02c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:04.009173 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ba4d5e1-55e0-484b-b4b0-ff91ce7a02c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:04.252511 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7ba4d5e1-55e0-484b-b4b0-ff91ce7a02c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.281274 May 28 14:37:04.253191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 713/1435] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:03 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:05.266697 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-02397bac-eeed-4952-bb9e-8a11e3a08340 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:05.268878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-02397bac-eeed-4952-bb9e-8a11e3a08340 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:05.281856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02397bac-eeed-4952-bb9e-8a11e3a08340 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:05.282513 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02397bac-eeed-4952-bb9e-8a11e3a08340 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:05.283659 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02397bac-eeed-4952-bb9e-8a11e3a08340 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:05.284292 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-02397bac-eeed-4952-bb9e-8a11e3a08340 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:05.385832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-02397bac-eeed-4952-bb9e-8a11e3a08340 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.124867 May 28 14:37:05.386485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 723/1436] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:05 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:06.398878 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2dd3c735-de99-4dc9-8b4d-b46b5770eeda tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:06.400096 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2dd3c735-de99-4dc9-8b4d-b46b5770eeda tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:06.408138 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2dd3c735-de99-4dc9-8b4d-b46b5770eeda tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:06.408599 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2dd3c735-de99-4dc9-8b4d-b46b5770eeda tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:06.409391 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2dd3c735-de99-4dc9-8b4d-b46b5770eeda tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:06.409845 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2dd3c735-de99-4dc9-8b4d-b46b5770eeda tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:06.505664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2dd3c735-de99-4dc9-8b4d-b46b5770eeda tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.110695 May 28 14:37:06.506221 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 714/1437] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:06 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:07.518323 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e68a64bd-2d6b-4b1f-a352-01cb6a8de039 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:07.519388 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e68a64bd-2d6b-4b1f-a352-01cb6a8de039 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:07.528384 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e68a64bd-2d6b-4b1f-a352-01cb6a8de039 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:07.528896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e68a64bd-2d6b-4b1f-a352-01cb6a8de039 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:07.530104 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e68a64bd-2d6b-4b1f-a352-01cb6a8de039 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:07.530569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e68a64bd-2d6b-4b1f-a352-01cb6a8de039 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:07.641322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e68a64bd-2d6b-4b1f-a352-01cb6a8de039 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.127030 May 28 14:37:07.641989 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 724/1438] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:07 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:08.655079 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-60b360e1-32ff-4f6e-a69f-696d1d7398fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:08.656820 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-60b360e1-32ff-4f6e-a69f-696d1d7398fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:08.665916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60b360e1-32ff-4f6e-a69f-696d1d7398fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:08.666384 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60b360e1-32ff-4f6e-a69f-696d1d7398fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:08.667208 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60b360e1-32ff-4f6e-a69f-696d1d7398fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:08.667679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-60b360e1-32ff-4f6e-a69f-696d1d7398fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:08.766035 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-60b360e1-32ff-4f6e-a69f-696d1d7398fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.115843 May 28 14:37:08.766684 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 715/1439] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:08 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:09.779348 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-837288bb-b70d-4eb6-bd2d-f9c9ce40bf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:09.780424 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-837288bb-b70d-4eb6-bd2d-f9c9ce40bf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:09.788441 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-837288bb-b70d-4eb6-bd2d-f9c9ce40bf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:09.789001 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-837288bb-b70d-4eb6-bd2d-f9c9ce40bf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:09.789863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-837288bb-b70d-4eb6-bd2d-f9c9ce40bf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:09.790418 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-837288bb-b70d-4eb6-bd2d-f9c9ce40bf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:09.895914 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-837288bb-b70d-4eb6-bd2d-f9c9ce40bf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.121138 May 28 14:37:09.899207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 725/1440] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:09 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:10.908084 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f4199d8f-43c7-4f50-b65a-e08c101013ec tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:10.909095 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f4199d8f-43c7-4f50-b65a-e08c101013ec tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:10.917275 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4199d8f-43c7-4f50-b65a-e08c101013ec tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:10.917760 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4199d8f-43c7-4f50-b65a-e08c101013ec tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:10.919093 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4199d8f-43c7-4f50-b65a-e08c101013ec tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:10.919570 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f4199d8f-43c7-4f50-b65a-e08c101013ec tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:11.025652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f4199d8f-43c7-4f50-b65a-e08c101013ec tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.121712 May 28 14:37:11.026719 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 716/1441] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:10 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:12.038159 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e0334b41-a901-4816-9eec-3f2a93d8a5bd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:12.039174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e0334b41-a901-4816-9eec-3f2a93d8a5bd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:12.047436 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e0334b41-a901-4816-9eec-3f2a93d8a5bd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:12.047935 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e0334b41-a901-4816-9eec-3f2a93d8a5bd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:12.048738 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e0334b41-a901-4816-9eec-3f2a93d8a5bd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:12.056176 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e0334b41-a901-4816-9eec-3f2a93d8a5bd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:12.151874 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e0334b41-a901-4816-9eec-3f2a93d8a5bd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.117609 May 28 14:37:12.153186 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 726/1442] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:12 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:13.165023 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-99add20a-33c6-4fb2-9066-63458677e7a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:13.165938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-99add20a-33c6-4fb2-9066-63458677e7a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:13.174220 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-99add20a-33c6-4fb2-9066-63458677e7a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:13.174671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-99add20a-33c6-4fb2-9066-63458677e7a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:13.175450 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-99add20a-33c6-4fb2-9066-63458677e7a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:13.175914 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-99add20a-33c6-4fb2-9066-63458677e7a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:13.288520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-99add20a-33c6-4fb2-9066-63458677e7a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.127589 May 28 14:37:13.289160 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 717/1443] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:13 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:14.300980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b55b1e63-13c6-4af8-ab7b-e12c09d260b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:14.301981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b55b1e63-13c6-4af8-ab7b-e12c09d260b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:14.309744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b55b1e63-13c6-4af8-ab7b-e12c09d260b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:14.310197 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b55b1e63-13c6-4af8-ab7b-e12c09d260b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:14.310969 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b55b1e63-13c6-4af8-ab7b-e12c09d260b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:14.311409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b55b1e63-13c6-4af8-ab7b-e12c09d260b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:14.409245 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b55b1e63-13c6-4af8-ab7b-e12c09d260b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.112392 May 28 14:37:14.409872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 727/1444] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:14 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:37:15.422212 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2a129ae2-5f43-4116-b4b4-f8822fb5010c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:15.423224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2a129ae2-5f43-4116-b4b4-f8822fb5010c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:15.431419 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2a129ae2-5f43-4116-b4b4-f8822fb5010c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:15.431907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2a129ae2-5f43-4116-b4b4-f8822fb5010c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:15.432705 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2a129ae2-5f43-4116-b4b4-f8822fb5010c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:15.433146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2a129ae2-5f43-4116-b4b4-f8822fb5010c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:15.533569 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2a129ae2-5f43-4116-b4b4-f8822fb5010c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.115836 May 28 14:37:15.534120 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 718/1445] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:15 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:16.545792 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3025ca25-fa25-4373-8b95-19e47c04c89e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:16.546799 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3025ca25-fa25-4373-8b95-19e47c04c89e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:16.554681 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3025ca25-fa25-4373-8b95-19e47c04c89e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:16.555137 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3025ca25-fa25-4373-8b95-19e47c04c89e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:16.555950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3025ca25-fa25-4373-8b95-19e47c04c89e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:16.556387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3025ca25-fa25-4373-8b95-19e47c04c89e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:16.648829 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3025ca25-fa25-4373-8b95-19e47c04c89e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.106908 May 28 14:37:16.649476 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 728/1446] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:16 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:17.661207 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-21a23138-9807-4e05-a99c-98c937ab7015 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:17.662345 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-21a23138-9807-4e05-a99c-98c937ab7015 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:17.670888 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-21a23138-9807-4e05-a99c-98c937ab7015 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:17.671335 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-21a23138-9807-4e05-a99c-98c937ab7015 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:17.672129 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-21a23138-9807-4e05-a99c-98c937ab7015 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:17.672566 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-21a23138-9807-4e05-a99c-98c937ab7015 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:17.768892 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-21a23138-9807-4e05-a99c-98c937ab7015 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.111735 May 28 14:37:17.769521 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 719/1447] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:17 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:18.781827 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-46b36e78-28ce-4a13-8327-d53e08f19e5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:18.782836 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-46b36e78-28ce-4a13-8327-d53e08f19e5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:18.790838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-46b36e78-28ce-4a13-8327-d53e08f19e5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:18.791294 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-46b36e78-28ce-4a13-8327-d53e08f19e5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:18.792109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-46b36e78-28ce-4a13-8327-d53e08f19e5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:18.793198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-46b36e78-28ce-4a13-8327-d53e08f19e5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:18.883886 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-46b36e78-28ce-4a13-8327-d53e08f19e5a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.106492 May 28 14:37:18.884522 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 729/1448] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:18 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:19.896795 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-513e60dd-9692-4b8f-9ed9-e6e5b911bf94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:19.897805 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-513e60dd-9692-4b8f-9ed9-e6e5b911bf94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:19.906284 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-513e60dd-9692-4b8f-9ed9-e6e5b911bf94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:19.906741 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-513e60dd-9692-4b8f-9ed9-e6e5b911bf94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:19.907533 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-513e60dd-9692-4b8f-9ed9-e6e5b911bf94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:19.908009 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-513e60dd-9692-4b8f-9ed9-e6e5b911bf94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:20.001754 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-513e60dd-9692-4b8f-9ed9-e6e5b911bf94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.109027 May 28 14:37:20.002389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 720/1449] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:19 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:21.014640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-dde26099-d2eb-4ef9-8113-efcf68f3af77 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:21.015726 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-dde26099-d2eb-4ef9-8113-efcf68f3af77 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:21.024287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dde26099-d2eb-4ef9-8113-efcf68f3af77 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:21.024751 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dde26099-d2eb-4ef9-8113-efcf68f3af77 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:21.025599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dde26099-d2eb-4ef9-8113-efcf68f3af77 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:21.026044 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-dde26099-d2eb-4ef9-8113-efcf68f3af77 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:21.124780 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-dde26099-d2eb-4ef9-8113-efcf68f3af77 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.114790 May 28 14:37:21.125417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 730/1450] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:21 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:22.137871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e90fe786-3007-4f35-b9d5-bd236b017bd1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:22.138796 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e90fe786-3007-4f35-b9d5-bd236b017bd1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:22.146818 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e90fe786-3007-4f35-b9d5-bd236b017bd1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:22.147281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e90fe786-3007-4f35-b9d5-bd236b017bd1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:22.148089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e90fe786-3007-4f35-b9d5-bd236b017bd1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:22.148536 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e90fe786-3007-4f35-b9d5-bd236b017bd1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:22.248102 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e90fe786-3007-4f35-b9d5-bd236b017bd1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.114961 May 28 14:37:22.248782 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 721/1451] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:22 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:23.260207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b246bdeb-540f-4f43-a266-af46459d74eb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:23.261286 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b246bdeb-540f-4f43-a266-af46459d74eb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:23.269854 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b246bdeb-540f-4f43-a266-af46459d74eb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:23.270309 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b246bdeb-540f-4f43-a266-af46459d74eb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:23.271083 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b246bdeb-540f-4f43-a266-af46459d74eb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:23.271521 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b246bdeb-540f-4f43-a266-af46459d74eb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:23.365495 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b246bdeb-540f-4f43-a266-af46459d74eb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.109253 May 28 14:37:23.366134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 731/1452] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:23 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:24.378163 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b86d3ead-fc5a-451c-90bc-a41018a160bc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:24.379167 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b86d3ead-fc5a-451c-90bc-a41018a160bc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:24.387612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b86d3ead-fc5a-451c-90bc-a41018a160bc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:24.388075 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b86d3ead-fc5a-451c-90bc-a41018a160bc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:24.388870 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b86d3ead-fc5a-451c-90bc-a41018a160bc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:24.389304 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b86d3ead-fc5a-451c-90bc-a41018a160bc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:24.482437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b86d3ead-fc5a-451c-90bc-a41018a160bc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.108253 May 28 14:37:24.483065 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 722/1453] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:24 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:25.496508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5de49930-ab12-4a03-8255-4e43c4b93684 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:25.497466 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5de49930-ab12-4a03-8255-4e43c4b93684 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:25.505599 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5de49930-ab12-4a03-8255-4e43c4b93684 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:25.506055 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5de49930-ab12-4a03-8255-4e43c4b93684 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:25.506855 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5de49930-ab12-4a03-8255-4e43c4b93684 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:25.507304 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5de49930-ab12-4a03-8255-4e43c4b93684 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:25.607665 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5de49930-ab12-4a03-8255-4e43c4b93684 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28686 microversion: 2.1 time: 0.116888 May 28 14:37:25.608316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 732/1454] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:25 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28686 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:26.622930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8a374ee1-4859-4f34-9a8f-47fcecd96951 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:26.624464 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8a374ee1-4859-4f34-9a8f-47fcecd96951 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:26.636627 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8a374ee1-4859-4f34-9a8f-47fcecd96951 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:26.637251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8a374ee1-4859-4f34-9a8f-47fcecd96951 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:26.638587 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8a374ee1-4859-4f34-9a8f-47fcecd96951 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:26.639370 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8a374ee1-4859-4f34-9a8f-47fcecd96951 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:26.742689 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8a374ee1-4859-4f34-9a8f-47fcecd96951 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 28701 microversion: 2.1 time: 0.126159 May 28 14:37:26.743616 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 723/1455] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:26 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 28701 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:27.755476 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-51d099d5-af3e-414b-9914-e6a7bcde0752 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:27.756511 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-51d099d5-af3e-414b-9914-e6a7bcde0752 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:27.765101 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51d099d5-af3e-414b-9914-e6a7bcde0752 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:27.765564 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51d099d5-af3e-414b-9914-e6a7bcde0752 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:27.766374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51d099d5-af3e-414b-9914-e6a7bcde0752 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:27.766850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-51d099d5-af3e-414b-9914-e6a7bcde0752 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:27.867256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-51d099d5-af3e-414b-9914-e6a7bcde0752 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 30790 microversion: 2.1 time: 0.115802 May 28 14:37:27.868482 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 733/1456] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:27 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 30790 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:28.880382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-376a4976-4b0d-44cc-abf4-97789f748d05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:28.881420 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-376a4976-4b0d-44cc-abf4-97789f748d05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:28.889520 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-376a4976-4b0d-44cc-abf4-97789f748d05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:28.890005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-376a4976-4b0d-44cc-abf4-97789f748d05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:28.890855 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-376a4976-4b0d-44cc-abf4-97789f748d05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:28.891286 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-376a4976-4b0d-44cc-abf4-97789f748d05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:29.004716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-376a4976-4b0d-44cc-abf4-97789f748d05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 32437 microversion: 2.1 time: 0.128440 May 28 14:37:29.005411 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 724/1457] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:28 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 32437 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:30.018280 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-de6dc3e6-030c-451c-8a6f-9af74e036e66 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:30.019324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-de6dc3e6-030c-451c-8a6f-9af74e036e66 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:30.031425 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de6dc3e6-030c-451c-8a6f-9af74e036e66 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:30.031958 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de6dc3e6-030c-451c-8a6f-9af74e036e66 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:30.033319 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de6dc3e6-030c-451c-8a6f-9af74e036e66 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:30.034159 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-de6dc3e6-030c-451c-8a6f-9af74e036e66 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:30.136489 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-de6dc3e6-030c-451c-8a6f-9af74e036e66 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 33431 microversion: 2.1 time: 0.122171 May 28 14:37:30.137355 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 734/1458] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:30 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 33431 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:31.149241 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ed44f208-5f7e-441b-b134-12ad8b00b9c3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:31.150180 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ed44f208-5f7e-441b-b134-12ad8b00b9c3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:31.158683 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ed44f208-5f7e-441b-b134-12ad8b00b9c3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:31.159146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ed44f208-5f7e-441b-b134-12ad8b00b9c3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:31.160007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ed44f208-5f7e-441b-b134-12ad8b00b9c3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:31.160451 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ed44f208-5f7e-441b-b134-12ad8b00b9c3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:31.270773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ed44f208-5f7e-441b-b134-12ad8b00b9c3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 34750 microversion: 2.1 time: 0.125793 May 28 14:37:31.271452 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 725/1459] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:31 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 34750 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:37:32.283940 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-db66fefe-f2ce-4169-bf15-e430f521ebcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:32.284943 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-db66fefe-f2ce-4169-bf15-e430f521ebcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:32.292975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db66fefe-f2ce-4169-bf15-e430f521ebcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:32.293432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db66fefe-f2ce-4169-bf15-e430f521ebcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:32.294815 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db66fefe-f2ce-4169-bf15-e430f521ebcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:32.295254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-db66fefe-f2ce-4169-bf15-e430f521ebcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:32.396287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-db66fefe-f2ce-4169-bf15-e430f521ebcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 35950 microversion: 2.1 time: 0.116222 May 28 14:37:32.397191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 735/1460] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:32 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 35950 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:33.408987 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d28ab20f-387b-45ae-b618-36f43102ab4a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:33.409986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d28ab20f-387b-45ae-b618-36f43102ab4a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:33.417873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d28ab20f-387b-45ae-b618-36f43102ab4a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:33.418419 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d28ab20f-387b-45ae-b618-36f43102ab4a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:33.419201 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d28ab20f-387b-45ae-b618-36f43102ab4a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:33.419660 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d28ab20f-387b-45ae-b618-36f43102ab4a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:33.515629 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d28ab20f-387b-45ae-b618-36f43102ab4a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 37636 microversion: 2.1 time: 0.110436 May 28 14:37:33.516497 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 726/1461] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:33 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 37636 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:34.529492 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-036b8cf6-dcbe-4934-b03c-89d736c4ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:34.530488 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-036b8cf6-dcbe-4934-b03c-89d736c4ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:34.538584 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-036b8cf6-dcbe-4934-b03c-89d736c4ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:34.539086 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-036b8cf6-dcbe-4934-b03c-89d736c4ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:34.539900 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-036b8cf6-dcbe-4934-b03c-89d736c4ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:34.540349 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-036b8cf6-dcbe-4934-b03c-89d736c4ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:34.641950 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-036b8cf6-dcbe-4934-b03c-89d736c4ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 38221 microversion: 2.1 time: 0.116555 May 28 14:37:34.642575 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 736/1462] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:34 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 38221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:35.655288 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-03e3c169-60ae-42ee-a65d-9e90ea6e4a6d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:35.656278 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-03e3c169-60ae-42ee-a65d-9e90ea6e4a6d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:35.664366 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-03e3c169-60ae-42ee-a65d-9e90ea6e4a6d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:35.664820 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-03e3c169-60ae-42ee-a65d-9e90ea6e4a6d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:35.665613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-03e3c169-60ae-42ee-a65d-9e90ea6e4a6d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:35.666056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-03e3c169-60ae-42ee-a65d-9e90ea6e4a6d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:35.766334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-03e3c169-60ae-42ee-a65d-9e90ea6e4a6d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 38221 microversion: 2.1 time: 0.115578 May 28 14:37:35.767153 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 727/1463] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:35 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 38221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:36.778980 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-778243b4-9171-4c15-9e97-1545ff3ce249 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:36.780611 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-778243b4-9171-4c15-9e97-1545ff3ce249 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:36.789067 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-778243b4-9171-4c15-9e97-1545ff3ce249 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:36.789520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-778243b4-9171-4c15-9e97-1545ff3ce249 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:36.790308 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-778243b4-9171-4c15-9e97-1545ff3ce249 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:36.790747 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-778243b4-9171-4c15-9e97-1545ff3ce249 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:36.886620 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-778243b4-9171-4c15-9e97-1545ff3ce249 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 38221 microversion: 2.1 time: 0.111775 May 28 14:37:36.887254 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 737/1464] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:36 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 38221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:37.898876 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ab322d1a-8cc0-4bef-b9c0-1ff57b72b52b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:37.899938 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ab322d1a-8cc0-4bef-b9c0-1ff57b72b52b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:37.908864 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab322d1a-8cc0-4bef-b9c0-1ff57b72b52b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:37.909318 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab322d1a-8cc0-4bef-b9c0-1ff57b72b52b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:37.910117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab322d1a-8cc0-4bef-b9c0-1ff57b72b52b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:37.910557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab322d1a-8cc0-4bef-b9c0-1ff57b72b52b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:38.013374 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ab322d1a-8cc0-4bef-b9c0-1ff57b72b52b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 38238 microversion: 2.1 time: 0.118436 May 28 14:37:38.014056 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 728/1465] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:37 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 38238 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:39.026590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-071c3a46-2955-4281-a723-342f89071a2c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:39.027637 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-071c3a46-2955-4281-a723-342f89071a2c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:39.036258 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-071c3a46-2955-4281-a723-342f89071a2c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:39.036715 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-071c3a46-2955-4281-a723-342f89071a2c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:39.037487 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-071c3a46-2955-4281-a723-342f89071a2c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:39.037928 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-071c3a46-2955-4281-a723-342f89071a2c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:39.133529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-071c3a46-2955-4281-a723-342f89071a2c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 200 len: 38352 microversion: 2.1 time: 0.110892 May 28 14:37:39.134075 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 738/1466] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:39 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 38352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:37:39.144732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-31b09f97-5a6b-49b8-90f8-44fd564bcc7c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:39.145312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-31b09f97-5a6b-49b8-90f8-44fd564bcc7c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:39.153219 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-31b09f97-5a6b-49b8-90f8-44fd564bcc7c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:39.153670 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-31b09f97-5a6b-49b8-90f8-44fd564bcc7c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:39.155097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-31b09f97-5a6b-49b8-90f8-44fd564bcc7c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:39.155529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-31b09f97-5a6b-49b8-90f8-44fd564bcc7c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:39.210201 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-31b09f97-5a6b-49b8-90f8-44fd564bcc7c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/ips" status: 200 len: 145 microversion: 2.1 time: 0.069505 May 28 14:37:39.210756 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 729/1467] 10.222.0.59 () {58 vars in 1248 bytes} [Fri May 28 14:37:39 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/ips => generated 145 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:37:42.079975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4360b1d6-528c-425d-8263-818fd6bf6d73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a0f5bb1-7687-4001-a563-802329fa4244"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:42.081142 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4360b1d6-528c-425d-8263-818fd6bf6d73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:42.089054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4360b1d6-528c-425d-8263-818fd6bf6d73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:42.089520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4360b1d6-528c-425d-8263-818fd6bf6d73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:42.090306 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4360b1d6-528c-425d-8263-818fd6bf6d73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:42.090761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4360b1d6-528c-425d-8263-818fd6bf6d73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:42.835045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4360b1d6-528c-425d-8263-818fd6bf6d73 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758907 May 28 14:37:42.840221 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 739/1468] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:37:42 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:37:50.607301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7b2fa925-32b5-4023-92c3-e2b75cad5a48 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:37:50.615776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b2fa925-32b5-4023-92c3-e2b75cad5a48 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:50.616235 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7b2fa925-32b5-4023-92c3-e2b75cad5a48 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:50.670329 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7b2fa925-32b5-4023-92c3-e2b75cad5a48 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Going to try to stop instance {{(pid=106812) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 28 14:37:50.884813 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7b2fa925-32b5-4023-92c3-e2b75cad5a48 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 202 len: 0 microversion: 2.1 time: 0.281109 May 28 14:37:50.885423 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 730/1469] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:37:50 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:37:50.895352 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-083c1918-e428-48bd-9133-54243c159f8c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:50.896130 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-083c1918-e428-48bd-9133-54243c159f8c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:50.904554 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-083c1918-e428-48bd-9133-54243c159f8c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:50.905018 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-083c1918-e428-48bd-9133-54243c159f8c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:50.905812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-083c1918-e428-48bd-9133-54243c159f8c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:50.906266 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-083c1918-e428-48bd-9133-54243c159f8c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:51.101808 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-083c1918-e428-48bd-9133-54243c159f8c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:37:51.111156 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-083c1918-e428-48bd-9133-54243c159f8c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.221115 May 28 14:37:51.111744 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 740/1470] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:37:50 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:37:52.129476 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d8ea7018-b101-4245-b864-6eb3452ffbcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:52.130098 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d8ea7018-b101-4245-b864-6eb3452ffbcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:52.137618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8ea7018-b101-4245-b864-6eb3452ffbcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:52.138069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8ea7018-b101-4245-b864-6eb3452ffbcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:52.138840 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8ea7018-b101-4245-b864-6eb3452ffbcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:52.139283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d8ea7018-b101-4245-b864-6eb3452ffbcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:52.342821 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-d8ea7018-b101-4245-b864-6eb3452ffbcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:37:52.351717 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d8ea7018-b101-4245-b864-6eb3452ffbcb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.226928 May 28 14:37:52.358062 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 731/1471] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:37:52 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:37:53.369538 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-eeebd241-c246-4aee-a725-a1a02d9f4da8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:53.370170 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-eeebd241-c246-4aee-a725-a1a02d9f4da8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:53.377949 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eeebd241-c246-4aee-a725-a1a02d9f4da8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:53.378410 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eeebd241-c246-4aee-a725-a1a02d9f4da8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:53.379193 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eeebd241-c246-4aee-a725-a1a02d9f4da8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:53.379675 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-eeebd241-c246-4aee-a725-a1a02d9f4da8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:53.573618 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-eeebd241-c246-4aee-a725-a1a02d9f4da8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:37:53.582812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-eeebd241-c246-4aee-a725-a1a02d9f4da8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.217374 May 28 14:37:53.583381 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 741/1472] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:37:53 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:37:54.600687 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-20529824-ee37-416c-92a8-bb55635edd82 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:54.601347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-20529824-ee37-416c-92a8-bb55635edd82 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:54.611604 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-20529824-ee37-416c-92a8-bb55635edd82 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:54.612091 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-20529824-ee37-416c-92a8-bb55635edd82 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:54.612877 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-20529824-ee37-416c-92a8-bb55635edd82 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:54.613389 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-20529824-ee37-416c-92a8-bb55635edd82 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:54.815826 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-20529824-ee37-416c-92a8-bb55635edd82 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:37:54.825789 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-20529824-ee37-416c-92a8-bb55635edd82 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.229099 May 28 14:37:54.826366 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 732/1473] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:37:54 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:37:55.843866 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:55.844938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:55.852173 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:55.857725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:55.857725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:55.857725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:56.058112 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:37:56.066906 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.226817 May 28 14:37:56.067476 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 742/1474] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:37:55 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:37:57.084811 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:57.085393 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:57.092819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:57.093283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:57.094069 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:57.094518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:57.290952 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:37:57.300255 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.219445 May 28 14:37:57.300826 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 733/1475] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:37:57 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:37:58.317474 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c6262bc4-1007-4786-8135-4bd6198f2cfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:58.318103 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c6262bc4-1007-4786-8135-4bd6198f2cfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:58.328211 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c6262bc4-1007-4786-8135-4bd6198f2cfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:58.328727 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c6262bc4-1007-4786-8135-4bd6198f2cfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:58.329515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c6262bc4-1007-4786-8135-4bd6198f2cfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:58.329971 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c6262bc4-1007-4786-8135-4bd6198f2cfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:58.535600 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c6262bc4-1007-4786-8135-4bd6198f2cfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:37:58.544733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c6262bc4-1007-4786-8135-4bd6198f2cfa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.231033 May 28 14:37:58.545311 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 743/1476] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:37:58 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:37:59.561869 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:37:59.562486 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:37:59.570156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:59.570609 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:59.571381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:59.571851 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:59.769107 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:37:59.777765 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.219567 May 28 14:37:59.778274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 734/1477] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:37:59 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:00.794845 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3bf9cc80-9194-419e-b008-08063dfd5c1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:00.795456 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3bf9cc80-9194-419e-b008-08063dfd5c1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:00.803475 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bf9cc80-9194-419e-b008-08063dfd5c1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:00.803957 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bf9cc80-9194-419e-b008-08063dfd5c1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:00.804742 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bf9cc80-9194-419e-b008-08063dfd5c1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:00.805190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3bf9cc80-9194-419e-b008-08063dfd5c1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:01.014515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-3bf9cc80-9194-419e-b008-08063dfd5c1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:01.024077 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3bf9cc80-9194-419e-b008-08063dfd5c1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.232966 May 28 14:38:01.024660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 744/1478] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:00 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:02.040992 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ca7b02d0-48b4-4667-8ac6-048446534099 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:02.041640 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ca7b02d0-48b4-4667-8ac6-048446534099 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:02.049495 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca7b02d0-48b4-4667-8ac6-048446534099 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:02.049940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca7b02d0-48b4-4667-8ac6-048446534099 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:02.050706 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca7b02d0-48b4-4667-8ac6-048446534099 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:02.051136 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ca7b02d0-48b4-4667-8ac6-048446534099 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:02.252112 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ca7b02d0-48b4-4667-8ac6-048446534099 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:02.260922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ca7b02d0-48b4-4667-8ac6-048446534099 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.223700 May 28 14:38:02.261500 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 735/1479] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:02 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:03.277960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2e48b449-ab7a-404a-9a5a-c26843d270de tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:03.278574 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2e48b449-ab7a-404a-9a5a-c26843d270de tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:03.286474 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e48b449-ab7a-404a-9a5a-c26843d270de tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:03.286926 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e48b449-ab7a-404a-9a5a-c26843d270de tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:03.287743 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e48b449-ab7a-404a-9a5a-c26843d270de tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:03.288178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2e48b449-ab7a-404a-9a5a-c26843d270de tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:03.486590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2e48b449-ab7a-404a-9a5a-c26843d270de tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:03.495591 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2e48b449-ab7a-404a-9a5a-c26843d270de tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.221258 May 28 14:38:03.496118 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 745/1480] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:03 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:04.511922 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-6e512a21-bf9b-41f8-aebc-3dc610379271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:04.512544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-6e512a21-bf9b-41f8-aebc-3dc610379271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:04.520312 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6e512a21-bf9b-41f8-aebc-3dc610379271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:04.520763 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6e512a21-bf9b-41f8-aebc-3dc610379271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:04.521526 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6e512a21-bf9b-41f8-aebc-3dc610379271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:04.521961 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-6e512a21-bf9b-41f8-aebc-3dc610379271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:04.712136 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-6e512a21-bf9b-41f8-aebc-3dc610379271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:04.720819 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-6e512a21-bf9b-41f8-aebc-3dc610379271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.212587 May 28 14:38:04.721382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 736/1481] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:04 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:05.738320 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:05.738932 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:05.746389 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:05.746838 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:05.747643 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:05.748174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:05.950377 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:05.959621 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1723 microversion: 2.1 time: 0.225567 May 28 14:38:05.960190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 746/1482] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:05 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:06.976847 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-e09d6185-6991-49f3-8981-882130579713 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:06.977474 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-e09d6185-6991-49f3-8981-882130579713 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:06.984767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e09d6185-6991-49f3-8981-882130579713 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:06.985227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e09d6185-6991-49f3-8981-882130579713 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:06.986026 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e09d6185-6991-49f3-8981-882130579713 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:06.986523 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-e09d6185-6991-49f3-8981-882130579713 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:07.186743 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-e09d6185-6991-49f3-8981-882130579713 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:07.196071 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-e09d6185-6991-49f3-8981-882130579713 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1700 microversion: 2.1 time: 0.222975 May 28 14:38:07.196652 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 737/1483] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:06 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1700 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:07.212804 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:38:07.220696 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:07.221151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:07.277444 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Going to try to start instance {{(pid=106811) start /opt/stack/nova/nova/compute/api.py:2602}} May 28 14:38:07.541553 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 202 len: 0 microversion: 2.1 time: 0.332224 May 28 14:38:07.542165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 747/1484] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:38:07 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:38:07.550258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:07.551008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:07.558498 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:07.558950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:07.559759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:07.560196 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:07.754111 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:07.763394 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1709 microversion: 2.1 time: 0.216938 May 28 14:38:07.764427 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 738/1485] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:07 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1709 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:08.781382 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e78298ef-953f-468e-8b89-ae8707ac83d2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:08.782148 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e78298ef-953f-468e-8b89-ae8707ac83d2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:08.789833 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e78298ef-953f-468e-8b89-ae8707ac83d2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:08.790288 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e78298ef-953f-468e-8b89-ae8707ac83d2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:08.791067 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e78298ef-953f-468e-8b89-ae8707ac83d2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:08.791512 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e78298ef-953f-468e-8b89-ae8707ac83d2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:08.988064 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e78298ef-953f-468e-8b89-ae8707ac83d2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:08.997223 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e78298ef-953f-468e-8b89-ae8707ac83d2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1709 microversion: 2.1 time: 0.220087 May 28 14:38:08.997814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 748/1486] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:08 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1709 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:38:10.014893 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-09941aea-2c4a-46c7-91c0-9a3150fd007c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:38:10.015514 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-09941aea-2c4a-46c7-91c0-9a3150fd007c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:38:10.022968 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-09941aea-2c4a-46c7-91c0-9a3150fd007c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:10.023420 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-09941aea-2c4a-46c7-91c0-9a3150fd007c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:10.024226 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-09941aea-2c4a-46c7-91c0-9a3150fd007c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:10.024664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-09941aea-2c4a-46c7-91c0-9a3150fd007c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:10.221267 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-09941aea-2c4a-46c7-91c0-9a3150fd007c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:38:10.229996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-09941aea-2c4a-46c7-91c0-9a3150fd007c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1713 microversion: 2.1 time: 0.218806 May 28 14:38:10.230553 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 739/1487] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:38:10 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1713 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:14.429535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a1ba84c2-b9e4-4ae3-9573-4e7339a07d22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:14.430153 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a1ba84c2-b9e4-4ae3-9573-4e7339a07d22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:14.437498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a1ba84c2-b9e4-4ae3-9573-4e7339a07d22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:14.437962 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a1ba84c2-b9e4-4ae3-9573-4e7339a07d22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:14.438757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a1ba84c2-b9e4-4ae3-9573-4e7339a07d22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:14.439204 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a1ba84c2-b9e4-4ae3-9573-4e7339a07d22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:14.600782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-a1ba84c2-b9e4-4ae3-9573-4e7339a07d22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lazy-loading 'services' on Instance uuid 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:39:14.855924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a1ba84c2-b9e4-4ae3-9573-4e7339a07d22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/os-volume_attachments/6a0f5bb1-7687-4001-a563-802329fa4244" status: 202 len: 0 microversion: 2.1 time: 0.430196 May 28 14:39:14.856757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 749/1488] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:39:14 2021] DELETE /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/os-volume_attachments/6a0f5bb1-7687-4001-a563-802329fa4244 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:39:17.142171 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-23ef4a11-4903-482f-b421-a7b54d8caade tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:39:17.149977 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23ef4a11-4903-482f-b421-a7b54d8caade tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:17.150425 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-23ef4a11-4903-482f-b421-a7b54d8caade tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:17.208227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-23ef4a11-4903-482f-b421-a7b54d8caade tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Going to try to stop instance {{(pid=106812) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 28 14:39:17.367618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-23ef4a11-4903-482f-b421-a7b54d8caade tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 202 len: 0 microversion: 2.1 time: 0.228922 May 28 14:39:17.368437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 740/1489] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:39:17 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:39:17.378220 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:17.379056 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:17.386526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:17.386979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:17.387895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:17.388327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:17.593703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:17.602098 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.228206 May 28 14:39:17.602661 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 750/1490] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:17 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:18.074902 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:39:18.075141 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: Fri May 28 14:39:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:39:18.620083 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:18.620783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:18.628286 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:18.628736 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:18.629502 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:18.629940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:18.827421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:18.836411 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.220778 May 28 14:39:18.836984 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 741/1491] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:18 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:19.854027 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9106421e-1041-40fc-97af-0d2c263f4cd5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:19.854647 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9106421e-1041-40fc-97af-0d2c263f4cd5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:19.862090 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9106421e-1041-40fc-97af-0d2c263f4cd5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:19.862544 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9106421e-1041-40fc-97af-0d2c263f4cd5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:19.863319 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9106421e-1041-40fc-97af-0d2c263f4cd5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:19.863793 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9106421e-1041-40fc-97af-0d2c263f4cd5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:20.057812 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-9106421e-1041-40fc-97af-0d2c263f4cd5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:20.066297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9106421e-1041-40fc-97af-0d2c263f4cd5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.215962 May 28 14:39:20.066805 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 751/1492] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:19 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:21.083999 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c38a6660-d11c-4e25-851b-ff9cbcbe552f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:21.084565 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c38a6660-d11c-4e25-851b-ff9cbcbe552f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:21.091809 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c38a6660-d11c-4e25-851b-ff9cbcbe552f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:21.092278 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c38a6660-d11c-4e25-851b-ff9cbcbe552f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:21.093029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c38a6660-d11c-4e25-851b-ff9cbcbe552f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:21.093463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-c38a6660-d11c-4e25-851b-ff9cbcbe552f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:21.285355 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c38a6660-d11c-4e25-851b-ff9cbcbe552f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:21.294211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c38a6660-d11c-4e25-851b-ff9cbcbe552f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.214046 May 28 14:39:21.294773 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 742/1493] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:21 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:22.311435 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7f32ddae-4c41-436c-bf37-69fd7b6d973d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:22.312086 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7f32ddae-4c41-436c-bf37-69fd7b6d973d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:22.319409 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f32ddae-4c41-436c-bf37-69fd7b6d973d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:22.319892 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f32ddae-4c41-436c-bf37-69fd7b6d973d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:22.320670 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f32ddae-4c41-436c-bf37-69fd7b6d973d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:22.321132 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7f32ddae-4c41-436c-bf37-69fd7b6d973d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:22.629485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-7f32ddae-4c41-436c-bf37-69fd7b6d973d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:22.637631 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7f32ddae-4c41-436c-bf37-69fd7b6d973d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.330422 May 28 14:39:22.638185 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 752/1494] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:22 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:23.654402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:23.654956 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:23.662117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:23.662571 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:23.663336 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:23.663802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:23.866872 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:23.875902 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.225337 May 28 14:39:23.876463 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 743/1495] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:23 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:24.893350 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:24.893976 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:24.901317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:24.901774 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:24.902573 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:24.903021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:25.100636 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:25.109535 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.219960 May 28 14:39:25.110109 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 753/1496] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:24 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:26.127909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-92f97c49-1073-4cc4-9e3d-8a3926ea28af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:26.128455 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-92f97c49-1073-4cc4-9e3d-8a3926ea28af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:26.135785 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-92f97c49-1073-4cc4-9e3d-8a3926ea28af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:26.136249 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-92f97c49-1073-4cc4-9e3d-8a3926ea28af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:26.137031 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-92f97c49-1073-4cc4-9e3d-8a3926ea28af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:26.137482 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-92f97c49-1073-4cc4-9e3d-8a3926ea28af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:26.332970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-92f97c49-1073-4cc4-9e3d-8a3926ea28af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:26.341814 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-92f97c49-1073-4cc4-9e3d-8a3926ea28af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.217781 May 28 14:39:26.342380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 744/1497] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:26 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:27.359777 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:27.360387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:27.367751 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:27.368463 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:27.369259 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:27.369707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:27.567191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:27.575994 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1677 microversion: 2.1 time: 0.220433 May 28 14:39:27.576581 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 754/1498] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:27 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:28.593656 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-83403046-f1cc-4864-a55f-605bf64151b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:28.594281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-83403046-f1cc-4864-a55f-605bf64151b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:28.601624 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-83403046-f1cc-4864-a55f-605bf64151b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:28.602121 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-83403046-f1cc-4864-a55f-605bf64151b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:28.602924 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-83403046-f1cc-4864-a55f-605bf64151b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:28.603357 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-83403046-f1cc-4864-a55f-605bf64151b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:28.798189 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-83403046-f1cc-4864-a55f-605bf64151b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:28.806485 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-83403046-f1cc-4864-a55f-605bf64151b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1654 microversion: 2.1 time: 0.217210 May 28 14:39:28.807050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 745/1499] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:28 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1654 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:28.823079 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:39:28.832322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:28.832322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:28.887246 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Going to try to start instance {{(pid=106811) start /opt/stack/nova/nova/compute/api.py:2602}} May 28 14:39:29.122014 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action" status: 202 len: 0 microversion: 2.1 time: 0.302459 May 28 14:39:29.123111 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 755/1500] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:39:28 2021] POST /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:39:29.131257 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:29.132823 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:29.140140 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:29.140534 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:29.141357 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:29.141797 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:29.342066 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:29.350283 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1663 microversion: 2.1 time: 0.222728 May 28 14:39:29.350859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 746/1501] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:29 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1663 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:30.369316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:30.369929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:30.377886 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:30.378338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:30.379108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:30.379543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:30.583757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:30.592376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1663 microversion: 2.1 time: 0.227728 May 28 14:39:30.592940 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 756/1502] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:30 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1663 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:31.610374 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:39:31.610925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:39:31.621382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:31.621851 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:31.622703 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:39:31.623151 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:31.914262 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:39:31.922945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1667 microversion: 2.1 time: 0.316325 May 28 14:39:31.923548 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 747/1503] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:39:31 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1667 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:39:38.929759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:39:38.930439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:39:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:39:44.004841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:39:44.005420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: Fri May 28 14:39:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:40:35.269856 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bb01af7b-268c-4d99-bdfd-a9c219d11312 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:35.270518 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bb01af7b-268c-4d99-bdfd-a9c219d11312 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:35.278162 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb01af7b-268c-4d99-bdfd-a9c219d11312 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:35.278636 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb01af7b-268c-4d99-bdfd-a9c219d11312 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:35.279419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb01af7b-268c-4d99-bdfd-a9c219d11312 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:35.279890 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bb01af7b-268c-4d99-bdfd-a9c219d11312 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:35.340710 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bb01af7b-268c-4d99-bdfd-a9c219d11312 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Going to try to terminate instance {{(pid=106811) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:40:35.716770 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bb01af7b-268c-4d99-bdfd-a9c219d11312 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 204 len: 0 microversion: 2.1 time: 0.450387 May 28 14:40:35.717364 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 757/1504] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:40:35 2021] DELETE /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:40:35.723684 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e218803b-6856-4257-89a8-6a2e16c4d566] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:40:35.728097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:35.728097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:35.736007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:35.736517 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:35.737351 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:35.737810 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:35.935949 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:35.944532 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1673 microversion: 2.1 time: 0.222212 May 28 14:40:35.945094 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 748/1505] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:35 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:36.962708 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:36.963403 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:36.971310 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:36.971915 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:36.972698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:36.973136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:37.175634 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:37.183971 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1673 microversion: 2.1 time: 0.225314 May 28 14:40:37.184539 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 758/1506] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:36 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1673 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:38.201121 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:38.201726 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:38.221623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:38.222750 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:38.223591 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:38.224008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:38.261279 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] [e218803b-6856-4257-89a8-6a2e16c4d566] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 56272. May 28 14:40:38.429300 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:38.437518 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1673 microversion: 2.1 time: 0.240159 May 28 14:40:38.438089 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 749/1507] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:38 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:39.454278 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8aed125d-703a-4720-aeab-1d1704b6d862 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:39.455047 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-8aed125d-703a-4720-aeab-1d1704b6d862 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:39.463066 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8aed125d-703a-4720-aeab-1d1704b6d862 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:39.463639 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8aed125d-703a-4720-aeab-1d1704b6d862 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:39.464445 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8aed125d-703a-4720-aeab-1d1704b6d862 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:39.464895 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-8aed125d-703a-4720-aeab-1d1704b6d862 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:39.588818 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-6bf5d0dc-51ff-4495-b201-178a462db214 req-9a6e7f9c-a976-4735-bf9d-a37e6834b4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c47c54c-f1cc-46f3-9e0f-5868ae50ba46", "name": "network-vif-deleted", "tag": "c41d8419-2408-4487-95f1-5b6ce2ba8dab"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:40:39.590429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:40:39.590429 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:40:39.595049 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-8aed125d-703a-4720-aeab-1d1704b6d862 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:39.600350 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-6bf5d0dc-51ff-4495-b201-178a462db214 req-9a6e7f9c-a976-4735-bf9d-a37e6834b4f4 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:39.600794 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-6bf5d0dc-51ff-4495-b201-178a462db214 req-9a6e7f9c-a976-4735-bf9d-a37e6834b4f4 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:39.606885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8aed125d-703a-4720-aeab-1d1704b6d862 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1606 microversion: 2.1 time: 0.156204 May 28 14:40:39.611020 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 759/1508] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:39 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1606 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:39.618812 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-6bf5d0dc-51ff-4495-b201-178a462db214 req-9a6e7f9c-a976-4735-bf9d-a37e6834b4f4 service nova] Creating event network-vif-deleted:c41d8419-2408-4487-95f1-5b6ce2ba8dab for instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 on hv-cinder-79128 May 28 14:40:39.624176 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-6bf5d0dc-51ff-4495-b201-178a462db214 req-9a6e7f9c-a976-4735-bf9d-a37e6834b4f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039021 May 28 14:40:39.624779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 750/1509] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:40:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:40:40.624963 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:40.625622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:40.633452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:40.633920 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:40.634723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:40.635168 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:40.705590 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:40.705983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:40.706463 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lazy-loading 'fault' on Instance uuid 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:40:40.853483 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:40.865878 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e8e50f35-512d-4c9c-b9de-f5315480cc42 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 200 len: 1328 microversion: 2.1 time: 0.244659 May 28 14:40:40.866473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 760/1510] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:40 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 1328 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:41.884856 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:41.885562 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:41.893115 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:41.893587 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:41.894378 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:41.894825 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:41.943707 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] HTTP exception thrown: Instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 could not be found. May 28 14:40:41.944303 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Returning 404 to user: Instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:40:41.945135 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3ba9194e-0b1f-480c-9537-9bd58db616f0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 404 len: 111 microversion: 2.1 time: 0.064551 May 28 14:40:41.945700 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 751/1511] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:41 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:40:41.953925 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-631ea4ff-34a8-4276-a6be-d3db30947fb4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '.version_select at 0x7f2aad9ba8b0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:42.055520 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-631ea4ff-34a8-4276-a6be-d3db30947fb4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122996061" status: 202 len: 0 microversion: 2.1 time: 0.105169 May 28 14:40:42.056117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 761/1512] 10.222.0.59 () {58 vars in 1221 bytes} [Fri May 28 14:40:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122996061 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:40:43.350029 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-dee2e089-d8a9-4290-b879-d4044545b064 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'create', calling method: .version_select at 0x7f2aadde6700>, body: {"keypair": {"name": "tempest-keypair-1400425300"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:40:43.373237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-dee2e089-d8a9-4290-b879-d4044545b064 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:40:43.377059 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-dee2e089-d8a9-4290-b879-d4044545b064 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for user 8c4e743e57e44cd78fe2e68ea8d97eb5 and project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:40:43.742170 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-dee2e089-d8a9-4290-b879-d4044545b064 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:40:43.746201 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.quota [None req-dee2e089-d8a9-4290-b879-d4044545b064 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for user 8c4e743e57e44cd78fe2e68ea8d97eb5 and project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'key_pairs'} {{(pid=106812) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:40:43.758871 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-dee2e089-d8a9-4290-b879-d4044545b064 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.412669 May 28 14:40:43.759657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 752/1513] 10.222.0.59 () {60 vars in 1158 bytes} [Fri May 28 14:40:43 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:40:46.626281 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1009893616", "imageRef": "bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d07aad82-58f0-48c7-bdbc-4ebfe5f698dc"}], "security_groups": [{"name": "tempest-securitygroup--1910356893"}], "key_name": "tempest-keypair-1400425300", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:40:46.741352 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.network.neutron [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] validate_networks() for [('d07aad82-58f0-48c7-bdbc-4ebfe5f698dc', None, None, None)] {{(pid=106811) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 28 14:40:47.376371 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Flavor limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 28 14:40:47.376811 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Image limits 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 28 14:40:47.377372 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Flavor pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 28 14:40:47.377773 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Image pref 0:0:0 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 28 14:40:47.378198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.virt.hardware [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=106811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 28 14:40:47.386622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:47.387079 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:47.387966 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:47.388475 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:47.405761 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:40:47.409757 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.quota [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Getting quotas for user 8c4e743e57e44cd78fe2e68ea8d97eb5 and project 61d5abfd60c747b5ad4bdeb820132545. Resources: {'ram', 'cores', 'instances'} {{(pid=106811) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:40:47.421823 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Going to run 1 instances... {{(pid=106811) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 28 14:40:47.424275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb3cc71c-cda8-4e49-b014-0a6cd8b4faf1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=106811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 28 14:40:47.576317 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-52a95255-081b-4a99-a63b-dd9cd9ece63b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.953945 May 28 14:40:47.576963 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 762/1514] 10.222.0.59 () {60 vars in 1147 bytes} [Fri May 28 14:40:46 2021] POST /compute/v2.1/servers => generated 402 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 14:40:47.587233 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-c93b67bb-30ff-4b63-a606-0da43f51d375 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:47.587829 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-c93b67bb-30ff-4b63-a606-0da43f51d375 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:47.748472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-c93b67bb-30ff-4b63-a606-0da43f51d375 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:47.755986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-c93b67bb-30ff-4b63-a606-0da43f51d375 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1238 microversion: 2.1 time: 0.172740 May 28 14:40:47.758587 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 753/1515] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:47 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1238 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:48.772896 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d4d01dd8-945a-459e-ac11-e5e3a81f1c72 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:48.773530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d4d01dd8-945a-459e-ac11-e5e3a81f1c72 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:48.843640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d4d01dd8-945a-459e-ac11-e5e3a81f1c72 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:48.852144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d4d01dd8-945a-459e-ac11-e5e3a81f1c72 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1238 microversion: 2.1 time: 0.083070 May 28 14:40:48.852696 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 763/1516] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:48 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:49.868357 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9e8cb4f4-afcf-4767-9afa-eda17f64e0af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:49.869274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9e8cb4f4-afcf-4767-9afa-eda17f64e0af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:49.940535 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-9e8cb4f4-afcf-4767-9afa-eda17f64e0af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:49.949033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9e8cb4f4-afcf-4767-9afa-eda17f64e0af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1238 microversion: 2.1 time: 0.084944 May 28 14:40:49.949664 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 754/1517] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:49 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:50.965907 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5b6c7146-81af-4930-a41c-ce866c82fdc0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:50.966515 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5b6c7146-81af-4930-a41c-ce866c82fdc0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:51.041340 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-5b6c7146-81af-4930-a41c-ce866c82fdc0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:51.049063 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5b6c7146-81af-4930-a41c-ce866c82fdc0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1238 microversion: 2.1 time: 0.087057 May 28 14:40:51.049625 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 764/1518] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:50 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:52.066352 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:52.066961 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:52.075646 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:52.076066 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:52.076852 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:52.077295 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:52.193529 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:52.202265 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1242 microversion: 2.1 time: 0.139738 May 28 14:40:52.202833 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 755/1519] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:52 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:53.218151 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:53.218795 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:53.229496 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:53.229949 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:53.230722 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:53.231156 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:53.343632 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:53.351979 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1290 microversion: 2.1 time: 0.137560 May 28 14:40:53.353048 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 765/1520] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:53 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1290 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:54.370758 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:54.371421 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:54.379132 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:54.379645 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:54.380434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:54.380892 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:54.496004 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:54.504213 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1296 microversion: 2.1 time: 0.138180 May 28 14:40:54.504783 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 756/1521] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:54 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:55.522000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-726b36e6-29a3-47c8-89cc-b7f024e53941 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:55.522673 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-726b36e6-29a3-47c8-89cc-b7f024e53941 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:55.530629 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-726b36e6-29a3-47c8-89cc-b7f024e53941 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:55.531080 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-726b36e6-29a3-47c8-89cc-b7f024e53941 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:55.531893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-726b36e6-29a3-47c8-89cc-b7f024e53941 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:55.532335 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-726b36e6-29a3-47c8-89cc-b7f024e53941 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:56.062722 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-726b36e6-29a3-47c8-89cc-b7f024e53941 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:56.072217 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-726b36e6-29a3-47c8-89cc-b7f024e53941 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1364 microversion: 2.1 time: 0.553907 May 28 14:40:56.074099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 766/1522] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:55 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:56.337488 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-2c908f52-1f3f-4b96-874b-a2a04dc684d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dfb653-07bf-461d-bd53-3f1346a89bb9", "tag": "10309ae3-44cf-4796-91db-63f78b0c6d94"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:40:56.339110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:40:56.339110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:40:56.348237 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-2c908f52-1f3f-4b96-874b-a2a04dc684d2 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:56.348724 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-2c908f52-1f3f-4b96-874b-a2a04dc684d2 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:56.366119 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-2c908f52-1f3f-4b96-874b-a2a04dc684d2 service nova] Creating event network-changed:10309ae3-44cf-4796-91db-63f78b0c6d94 for instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 on hv-cinder-79128 May 28 14:40:56.372074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-2c908f52-1f3f-4b96-874b-a2a04dc684d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040492 May 28 14:40:56.372702 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 757/1523] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:40:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:40:57.090034 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1cb3b100-72e4-432f-97ee-615b6ecaf151 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:57.090692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1cb3b100-72e4-432f-97ee-615b6ecaf151 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:57.098725 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1cb3b100-72e4-432f-97ee-615b6ecaf151 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:57.099187 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1cb3b100-72e4-432f-97ee-615b6ecaf151 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:57.100096 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1cb3b100-72e4-432f-97ee-615b6ecaf151 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:57.100547 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1cb3b100-72e4-432f-97ee-615b6ecaf151 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:57.412747 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-1cb3b100-72e4-432f-97ee-615b6ecaf151 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:57.420978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1cb3b100-72e4-432f-97ee-615b6ecaf151 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1364 microversion: 2.1 time: 0.335449 May 28 14:40:57.421552 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 767/1524] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:57 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:58.438430 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3eb9d720-8172-485f-90ef-3c499ce7286d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:58.439210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3eb9d720-8172-485f-90ef-3c499ce7286d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:58.447424 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3eb9d720-8172-485f-90ef-3c499ce7286d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:58.447901 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3eb9d720-8172-485f-90ef-3c499ce7286d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:58.448671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3eb9d720-8172-485f-90ef-3c499ce7286d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:58.449110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3eb9d720-8172-485f-90ef-3c499ce7286d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:58.760136 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-3eb9d720-8172-485f-90ef-3c499ce7286d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:40:58.768405 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3eb9d720-8172-485f-90ef-3c499ce7286d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1364 microversion: 2.1 time: 0.334264 May 28 14:40:58.768983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 758/1525] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:58 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:40:59.785909 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-c4b555e2-bef2-4a09-b5b8-a37373215564 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:40:59.786531 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-c4b555e2-bef2-4a09-b5b8-a37373215564 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:40:59.794396 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4b555e2-bef2-4a09-b5b8-a37373215564 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:59.794853 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4b555e2-bef2-4a09-b5b8-a37373215564 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:59.795662 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4b555e2-bef2-4a09-b5b8-a37373215564 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:59.796108 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-c4b555e2-bef2-4a09-b5b8-a37373215564 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:59.999759 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-c4b555e2-bef2-4a09-b5b8-a37373215564 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:41:00.007929 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-c4b555e2-bef2-4a09-b5b8-a37373215564 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1364 microversion: 2.1 time: 0.225732 May 28 14:41:00.008497 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 768/1526] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:40:59 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:41:01.025398 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-0720d16c-f972-4939-bcea-51d647d426fc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:41:01.026048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-0720d16c-f972-4939-bcea-51d647d426fc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:01.033557 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0720d16c-f972-4939-bcea-51d647d426fc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:01.034023 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0720d16c-f972-4939-bcea-51d647d426fc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:01.034834 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0720d16c-f972-4939-bcea-51d647d426fc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:01.035334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-0720d16c-f972-4939-bcea-51d647d426fc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:01.232469 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-0720d16c-f972-4939-bcea-51d647d426fc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:41:01.240662 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-0720d16c-f972-4939-bcea-51d647d426fc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1364 microversion: 2.1 time: 0.219678 May 28 14:41:01.241227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 759/1527] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:41:01 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:41:02.258818 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-91642a06-99b8-429c-8ae2-24a6131dadca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:41:02.259657 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-91642a06-99b8-429c-8ae2-24a6131dadca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:02.267011 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-91642a06-99b8-429c-8ae2-24a6131dadca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:02.267478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-91642a06-99b8-429c-8ae2-24a6131dadca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:02.268327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-91642a06-99b8-429c-8ae2-24a6131dadca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:02.268771 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-91642a06-99b8-429c-8ae2-24a6131dadca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:02.469104 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-91642a06-99b8-429c-8ae2-24a6131dadca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:41:02.477461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-91642a06-99b8-429c-8ae2-24a6131dadca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1364 microversion: 2.1 time: 0.222898 May 28 14:41:02.478136 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 769/1528] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:41:02 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:41:02.614673 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-7d3aca85-c085-4189-8fe8-6e45bff4378f req-f2baf664-6440-4f06-8b15-9bc16199683c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dfb653-07bf-461d-bd53-3f1346a89bb9", "name": "network-vif-plugged", "status": "completed", "tag": "10309ae3-44cf-4796-91db-63f78b0c6d94"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:02.616280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:41:02.616280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:41:02.626700 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-7d3aca85-c085-4189-8fe8-6e45bff4378f req-f2baf664-6440-4f06-8b15-9bc16199683c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:02.627270 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-7d3aca85-c085-4189-8fe8-6e45bff4378f req-f2baf664-6440-4f06-8b15-9bc16199683c service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:02.643696 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-7d3aca85-c085-4189-8fe8-6e45bff4378f req-f2baf664-6440-4f06-8b15-9bc16199683c service nova] Creating event network-vif-plugged:10309ae3-44cf-4796-91db-63f78b0c6d94 for instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 on hv-cinder-79128 May 28 14:41:02.648879 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-7d3aca85-c085-4189-8fe8-6e45bff4378f req-f2baf664-6440-4f06-8b15-9bc16199683c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172995 May 28 14:41:02.649637 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 760/1529] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:41:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:41:03.494422 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-76422f8e-2de7-46ad-9e87-54eca982d2e0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:41:03.495041 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-76422f8e-2de7-46ad-9e87-54eca982d2e0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:03.502404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-76422f8e-2de7-46ad-9e87-54eca982d2e0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:03.502867 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-76422f8e-2de7-46ad-9e87-54eca982d2e0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:03.503714 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-76422f8e-2de7-46ad-9e87-54eca982d2e0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:03.504161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-76422f8e-2de7-46ad-9e87-54eca982d2e0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:03.696425 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-76422f8e-2de7-46ad-9e87-54eca982d2e0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:41:03.704897 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-76422f8e-2de7-46ad-9e87-54eca982d2e0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1364 microversion: 2.1 time: 0.214444 May 28 14:41:03.713631 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 770/1530] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:41:03 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:41:04.723244 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-28e29913-2c36-4155-86a2-38ad8f5269f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:41:04.723996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-28e29913-2c36-4155-86a2-38ad8f5269f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:04.732125 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-28e29913-2c36-4155-86a2-38ad8f5269f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:04.732584 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-28e29913-2c36-4155-86a2-38ad8f5269f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:04.733384 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-28e29913-2c36-4155-86a2-38ad8f5269f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:04.733828 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-28e29913-2c36-4155-86a2-38ad8f5269f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:04.933491 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-28e29913-2c36-4155-86a2-38ad8f5269f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:41:04.941734 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-28e29913-2c36-4155-86a2-38ad8f5269f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1548 microversion: 2.1 time: 0.222633 May 28 14:41:04.942309 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 761/1531] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:41:04 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:41:04.957619 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:41:04.958149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:04.965885 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:04.966316 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:04.967097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:04.967538 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:05.127848 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173867 May 28 14:41:05.128447 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 771/1532] 10.222.0.59 () {58 vars in 1275 bytes} [Fri May 28 14:41:04 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:41:06.802007 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-eb50f386-20ef-4a6f-92ee-f7fc4fb17a39 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:06.802927 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-eb50f386-20ef-4a6f-92ee-f7fc4fb17a39 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:06.818101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eb50f386-20ef-4a6f-92ee-f7fc4fb17a39 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:06.818101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eb50f386-20ef-4a6f-92ee-f7fc4fb17a39 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:06.818101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eb50f386-20ef-4a6f-92ee-f7fc4fb17a39 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:06.818101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eb50f386-20ef-4a6f-92ee-f7fc4fb17a39 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:06.878826 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-00738e60-b247-4f7c-af02-d8aeff1dc581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dfb653-07bf-461d-bd53-3f1346a89bb9", "tag": "10309ae3-44cf-4796-91db-63f78b0c6d94"}]} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:06.880452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:41:06.880452 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: warnings.warn(msg) May 28 14:41:06.889460 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-00738e60-b247-4f7c-af02-d8aeff1dc581 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:06.889981 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-00738e60-b247-4f7c-af02-d8aeff1dc581 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:06.907614 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.compute.server_external_events [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-00738e60-b247-4f7c-af02-d8aeff1dc581 service nova] Creating event network-changed:10309ae3-44cf-4796-91db-63f78b0c6d94 for instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 on hv-cinder-79128 May 28 14:41:06.912754 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-00738e60-b247-4f7c-af02-d8aeff1dc581 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104166 May 28 14:41:06.913346 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 772/1533] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:41:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:41:06.915884 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-eb50f386-20ef-4a6f-92ee-f7fc4fb17a39 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.117861 May 28 14:41:06.919162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 762/1534] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:06 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:07.927296 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7a256f7a-cfa3-442f-8ced-3cdba39babf6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:07.928403 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7a256f7a-cfa3-442f-8ced-3cdba39babf6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:07.936913 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a256f7a-cfa3-442f-8ced-3cdba39babf6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:07.937374 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a256f7a-cfa3-442f-8ced-3cdba39babf6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:07.938255 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a256f7a-cfa3-442f-8ced-3cdba39babf6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:07.938704 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7a256f7a-cfa3-442f-8ced-3cdba39babf6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:08.036685 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7a256f7a-cfa3-442f-8ced-3cdba39babf6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.113411 May 28 14:41:08.037504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 773/1535] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:07 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:09.047981 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2768b099-6673-40ab-9623-787154793952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:09.049013 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2768b099-6673-40ab-9623-787154793952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:09.057575 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2768b099-6673-40ab-9623-787154793952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:09.058033 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2768b099-6673-40ab-9623-787154793952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:09.058842 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2768b099-6673-40ab-9623-787154793952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:09.059286 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2768b099-6673-40ab-9623-787154793952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:09.154945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2768b099-6673-40ab-9623-787154793952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.111107 May 28 14:41:09.155622 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 763/1536] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:09 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:10.166417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-9aa99b62-d2eb-4868-8721-89e0b59d2730 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:10.167412 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-9aa99b62-d2eb-4868-8721-89e0b59d2730 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:10.175300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9aa99b62-d2eb-4868-8721-89e0b59d2730 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:10.175794 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9aa99b62-d2eb-4868-8721-89e0b59d2730 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:10.176578 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9aa99b62-d2eb-4868-8721-89e0b59d2730 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:10.177014 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-9aa99b62-d2eb-4868-8721-89e0b59d2730 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:10.278461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-9aa99b62-d2eb-4868-8721-89e0b59d2730 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.116028 May 28 14:41:10.279126 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 774/1537] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:10 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:11.289442 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-450d53d4-b490-4e2e-801a-e5b2c3de27b5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:11.290600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-450d53d4-b490-4e2e-801a-e5b2c3de27b5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:11.298433 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-450d53d4-b490-4e2e-801a-e5b2c3de27b5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:11.298885 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-450d53d4-b490-4e2e-801a-e5b2c3de27b5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:11.299679 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-450d53d4-b490-4e2e-801a-e5b2c3de27b5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:11.300114 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-450d53d4-b490-4e2e-801a-e5b2c3de27b5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:11.391995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-450d53d4-b490-4e2e-801a-e5b2c3de27b5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.106572 May 28 14:41:11.392618 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 764/1538] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:11 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:12.403978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f76f2e9f-8740-42ca-8a1a-72fed4335a9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:12.404987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f76f2e9f-8740-42ca-8a1a-72fed4335a9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:12.412871 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f76f2e9f-8740-42ca-8a1a-72fed4335a9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:12.413324 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f76f2e9f-8740-42ca-8a1a-72fed4335a9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:12.414102 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f76f2e9f-8740-42ca-8a1a-72fed4335a9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:12.414542 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f76f2e9f-8740-42ca-8a1a-72fed4335a9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:12.507571 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f76f2e9f-8740-42ca-8a1a-72fed4335a9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.108133 May 28 14:41:12.508174 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 775/1539] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:12 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:12.939614 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:41:12.940192 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:41:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:41:13.519071 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8c6152ca-ee33-45eb-9bdd-23bc3a5264ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:13.520141 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8c6152ca-ee33-45eb-9bdd-23bc3a5264ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:13.528080 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8c6152ca-ee33-45eb-9bdd-23bc3a5264ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:13.528544 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8c6152ca-ee33-45eb-9bdd-23bc3a5264ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:13.529322 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8c6152ca-ee33-45eb-9bdd-23bc3a5264ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:13.529793 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8c6152ca-ee33-45eb-9bdd-23bc3a5264ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:13.620506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8c6152ca-ee33-45eb-9bdd-23bc3a5264ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.104926 May 28 14:41:13.621117 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 765/1540] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:13 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:14.632051 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-185cb252-3f16-4b0c-9c6c-3c5e0d62a80f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:14.633000 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-185cb252-3f16-4b0c-9c6c-3c5e0d62a80f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:14.641466 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-185cb252-3f16-4b0c-9c6c-3c5e0d62a80f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:14.641922 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-185cb252-3f16-4b0c-9c6c-3c5e0d62a80f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:14.642699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-185cb252-3f16-4b0c-9c6c-3c5e0d62a80f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:14.643145 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-185cb252-3f16-4b0c-9c6c-3c5e0d62a80f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:14.735381 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-185cb252-3f16-4b0c-9c6c-3c5e0d62a80f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.107440 May 28 14:41:14.736034 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 776/1541] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:14 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:15.747101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ab31468d-6779-4e88-8b10-39e4e503298f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:15.748124 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ab31468d-6779-4e88-8b10-39e4e503298f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:15.757443 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab31468d-6779-4e88-8b10-39e4e503298f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:15.757608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab31468d-6779-4e88-8b10-39e4e503298f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:15.758334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab31468d-6779-4e88-8b10-39e4e503298f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:15.758770 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ab31468d-6779-4e88-8b10-39e4e503298f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:15.853593 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ab31468d-6779-4e88-8b10-39e4e503298f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 14 microversion: 2.1 time: 0.110683 May 28 14:41:15.854211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 766/1542] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:15 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 14:41:16.865153 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1d538d4d-9202-4bd2-b455-28d68dc8ac2e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:16.866200 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1d538d4d-9202-4bd2-b455-28d68dc8ac2e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:16.874554 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1d538d4d-9202-4bd2-b455-28d68dc8ac2e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:16.875058 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1d538d4d-9202-4bd2-b455-28d68dc8ac2e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:16.875949 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1d538d4d-9202-4bd2-b455-28d68dc8ac2e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:16.876394 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1d538d4d-9202-4bd2-b455-28d68dc8ac2e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:16.967622 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1d538d4d-9202-4bd2-b455-28d68dc8ac2e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 10009 microversion: 2.1 time: 0.106603 May 28 14:41:16.968249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 777/1543] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:16 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 10009 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:17.979925 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fedbafd2-4f7c-4043-9dfc-7c68953feb3b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:17.980950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fedbafd2-4f7c-4043-9dfc-7c68953feb3b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:17.988779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fedbafd2-4f7c-4043-9dfc-7c68953feb3b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:17.989227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fedbafd2-4f7c-4043-9dfc-7c68953feb3b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:17.989996 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fedbafd2-4f7c-4043-9dfc-7c68953feb3b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:17.990511 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fedbafd2-4f7c-4043-9dfc-7c68953feb3b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:18.091154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fedbafd2-4f7c-4043-9dfc-7c68953feb3b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 17602 microversion: 2.1 time: 0.115689 May 28 14:41:18.091872 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 767/1544] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:17 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 17602 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:19.103191 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-302af564-a170-4ece-b304-731d99cc720d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:19.104169 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-302af564-a170-4ece-b304-731d99cc720d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:19.112880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-302af564-a170-4ece-b304-731d99cc720d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:19.113337 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-302af564-a170-4ece-b304-731d99cc720d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:19.114127 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-302af564-a170-4ece-b304-731d99cc720d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:19.114569 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-302af564-a170-4ece-b304-731d99cc720d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:19.213406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-302af564-a170-4ece-b304-731d99cc720d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 18777 microversion: 2.1 time: 0.114310 May 28 14:41:19.214043 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 778/1545] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:19 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 18777 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:20.226748 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-7ae49df1-77aa-4e15-bc1f-c4f51055066e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:20.227780 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-7ae49df1-77aa-4e15-bc1f-c4f51055066e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:20.236347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ae49df1-77aa-4e15-bc1f-c4f51055066e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:20.236802 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ae49df1-77aa-4e15-bc1f-c4f51055066e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:20.237591 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ae49df1-77aa-4e15-bc1f-c4f51055066e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:20.238032 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-7ae49df1-77aa-4e15-bc1f-c4f51055066e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:20.330692 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-7ae49df1-77aa-4e15-bc1f-c4f51055066e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 21463 microversion: 2.1 time: 0.108469 May 28 14:41:20.331316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 768/1546] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:20 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 21463 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:21.342807 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e49b122f-a92b-4a32-a551-6f2bdc270ae1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:21.343841 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e49b122f-a92b-4a32-a551-6f2bdc270ae1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:21.351901 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e49b122f-a92b-4a32-a551-6f2bdc270ae1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:21.352366 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e49b122f-a92b-4a32-a551-6f2bdc270ae1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:21.353167 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e49b122f-a92b-4a32-a551-6f2bdc270ae1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:21.353608 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e49b122f-a92b-4a32-a551-6f2bdc270ae1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:21.446764 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e49b122f-a92b-4a32-a551-6f2bdc270ae1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 23220 microversion: 2.1 time: 0.108485 May 28 14:41:21.447402 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 779/1547] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:21 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 23220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:22.458986 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2f2ce908-2b91-4034-923d-ad3504fe08c6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:22.460022 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2f2ce908-2b91-4034-923d-ad3504fe08c6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:22.468174 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f2ce908-2b91-4034-923d-ad3504fe08c6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:22.468636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f2ce908-2b91-4034-923d-ad3504fe08c6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:22.469467 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f2ce908-2b91-4034-923d-ad3504fe08c6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:22.469916 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f2ce908-2b91-4034-923d-ad3504fe08c6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:22.567630 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2f2ce908-2b91-4034-923d-ad3504fe08c6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 24634 microversion: 2.1 time: 0.112610 May 28 14:41:22.568995 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 769/1548] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:22 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 24634 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:23.580261 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-a90cb57c-f9c2-4945-ae9f-ac5424f6baa8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:23.581274 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-a90cb57c-f9c2-4945-ae9f-ac5424f6baa8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:23.589265 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a90cb57c-f9c2-4945-ae9f-ac5424f6baa8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:23.589723 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a90cb57c-f9c2-4945-ae9f-ac5424f6baa8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:23.590508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a90cb57c-f9c2-4945-ae9f-ac5424f6baa8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:23.590959 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-a90cb57c-f9c2-4945-ae9f-ac5424f6baa8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:23.686263 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-a90cb57c-f9c2-4945-ae9f-ac5424f6baa8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 26236 microversion: 2.1 time: 0.109948 May 28 14:41:23.686814 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 780/1549] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:23 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 26236 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:24.698347 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4bb53f1d-6caa-45c3-acc0-179ecd1f6487 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:24.699338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4bb53f1d-6caa-45c3-acc0-179ecd1f6487 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:24.707759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4bb53f1d-6caa-45c3-acc0-179ecd1f6487 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:24.708211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4bb53f1d-6caa-45c3-acc0-179ecd1f6487 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:24.708974 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4bb53f1d-6caa-45c3-acc0-179ecd1f6487 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:24.709408 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4bb53f1d-6caa-45c3-acc0-179ecd1f6487 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:24.804525 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4bb53f1d-6caa-45c3-acc0-179ecd1f6487 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 27398 microversion: 2.1 time: 0.110136 May 28 14:41:24.805156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 770/1550] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:24 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 27398 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:25.816999 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-ff7f9acc-2d01-444b-b29b-3ea72e4562b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:25.818046 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-ff7f9acc-2d01-444b-b29b-3ea72e4562b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:25.826065 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff7f9acc-2d01-444b-b29b-3ea72e4562b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:25.826527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff7f9acc-2d01-444b-b29b-3ea72e4562b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:25.827419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff7f9acc-2d01-444b-b29b-3ea72e4562b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:25.827905 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-ff7f9acc-2d01-444b-b29b-3ea72e4562b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:25.925750 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-ff7f9acc-2d01-444b-b29b-3ea72e4562b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 27859 microversion: 2.1 time: 0.112917 May 28 14:41:25.926499 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 781/1551] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:25 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 27859 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:26.937266 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fb5967a5-cd55-4dea-89b0-76afe9c89bee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:26.938271 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fb5967a5-cd55-4dea-89b0-76afe9c89bee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:26.946239 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fb5967a5-cd55-4dea-89b0-76afe9c89bee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:26.946697 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fb5967a5-cd55-4dea-89b0-76afe9c89bee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:26.947473 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fb5967a5-cd55-4dea-89b0-76afe9c89bee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:26.947944 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fb5967a5-cd55-4dea-89b0-76afe9c89bee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:27.045863 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fb5967a5-cd55-4dea-89b0-76afe9c89bee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.112691 May 28 14:41:27.046542 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 771/1552] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:26 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:28.058216 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-07a35872-616a-4015-bc42-01753303d871 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:28.059207 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-07a35872-616a-4015-bc42-01753303d871 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:28.067378 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07a35872-616a-4015-bc42-01753303d871 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:28.067772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07a35872-616a-4015-bc42-01753303d871 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:28.068562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07a35872-616a-4015-bc42-01753303d871 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:28.069004 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-07a35872-616a-4015-bc42-01753303d871 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:28.316249 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-07a35872-616a-4015-bc42-01753303d871 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.262048 May 28 14:41:28.316924 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 782/1553] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:28 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:29.329254 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b077c99a-9738-440d-8f5f-f9cdb2845e97 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:29.330280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b077c99a-9738-440d-8f5f-f9cdb2845e97 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:29.338162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b077c99a-9738-440d-8f5f-f9cdb2845e97 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:29.338617 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b077c99a-9738-440d-8f5f-f9cdb2845e97 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:29.339390 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b077c99a-9738-440d-8f5f-f9cdb2845e97 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:29.339862 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b077c99a-9738-440d-8f5f-f9cdb2845e97 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:29.437100 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b077c99a-9738-440d-8f5f-f9cdb2845e97 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.111881 May 28 14:41:29.437778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 772/1554] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:29 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:30.449404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-98f5310c-e5b4-4ce5-a93b-7303c7dd9c04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:30.450438 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-98f5310c-e5b4-4ce5-a93b-7303c7dd9c04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:30.458365 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-98f5310c-e5b4-4ce5-a93b-7303c7dd9c04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:30.458824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-98f5310c-e5b4-4ce5-a93b-7303c7dd9c04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:30.459630 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-98f5310c-e5b4-4ce5-a93b-7303c7dd9c04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:30.460076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-98f5310c-e5b4-4ce5-a93b-7303c7dd9c04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:30.553621 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-98f5310c-e5b4-4ce5-a93b-7303c7dd9c04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.108273 May 28 14:41:30.554257 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 783/1555] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:30 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:31.565955 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-082304fd-49ba-4a10-9287-d59eec6b215f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:31.566948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-082304fd-49ba-4a10-9287-d59eec6b215f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:31.574760 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-082304fd-49ba-4a10-9287-d59eec6b215f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:31.575210 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-082304fd-49ba-4a10-9287-d59eec6b215f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:31.576016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-082304fd-49ba-4a10-9287-d59eec6b215f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:31.576951 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-082304fd-49ba-4a10-9287-d59eec6b215f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:31.671274 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-082304fd-49ba-4a10-9287-d59eec6b215f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.109424 May 28 14:41:31.671868 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 773/1556] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:31 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:41:32.683074 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-66df505b-342d-4645-93db-48afc4d21f21 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:32.684117 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-66df505b-342d-4645-93db-48afc4d21f21 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:32.692012 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-66df505b-342d-4645-93db-48afc4d21f21 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:32.692473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-66df505b-342d-4645-93db-48afc4d21f21 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:32.693256 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-66df505b-342d-4645-93db-48afc4d21f21 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:32.693703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-66df505b-342d-4645-93db-48afc4d21f21 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:32.788387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-66df505b-342d-4645-93db-48afc4d21f21 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.109303 May 28 14:41:32.789031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 784/1557] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:32 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:33.800776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-41dbc1c2-848c-421c-b847-89c8865953bf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:33.801907 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-41dbc1c2-848c-421c-b847-89c8865953bf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:33.810169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41dbc1c2-848c-421c-b847-89c8865953bf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:33.810766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41dbc1c2-848c-421c-b847-89c8865953bf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:33.811608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41dbc1c2-848c-421c-b847-89c8865953bf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:33.812040 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-41dbc1c2-848c-421c-b847-89c8865953bf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:33.905950 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-41dbc1c2-848c-421c-b847-89c8865953bf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.109277 May 28 14:41:33.906906 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 774/1558] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:33 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:34.918149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-62d4846b-7cda-4c17-b1f5-42f50a2264df tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:34.919189 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-62d4846b-7cda-4c17-b1f5-42f50a2264df tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:34.927118 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62d4846b-7cda-4c17-b1f5-42f50a2264df tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:34.927601 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62d4846b-7cda-4c17-b1f5-42f50a2264df tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:34.928417 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62d4846b-7cda-4c17-b1f5-42f50a2264df tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:34.928863 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-62d4846b-7cda-4c17-b1f5-42f50a2264df tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:35.021087 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-62d4846b-7cda-4c17-b1f5-42f50a2264df tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.106956 May 28 14:41:35.021703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 785/1559] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:34 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:36.034000 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-414d4ecf-e708-4839-a643-163da450383e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:36.035006 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-414d4ecf-e708-4839-a643-163da450383e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:36.043193 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-414d4ecf-e708-4839-a643-163da450383e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:36.043686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-414d4ecf-e708-4839-a643-163da450383e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:36.044469 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-414d4ecf-e708-4839-a643-163da450383e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:36.044909 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-414d4ecf-e708-4839-a643-163da450383e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:36.148101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-414d4ecf-e708-4839-a643-163da450383e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.118610 May 28 14:41:36.148657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 775/1560] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:36 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:37.160694 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-32b1810a-3949-4788-b8e9-d55be4cea952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:37.161604 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-32b1810a-3949-4788-b8e9-d55be4cea952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:37.170448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-32b1810a-3949-4788-b8e9-d55be4cea952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:37.170912 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-32b1810a-3949-4788-b8e9-d55be4cea952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:37.171729 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-32b1810a-3949-4788-b8e9-d55be4cea952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:37.172177 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-32b1810a-3949-4788-b8e9-d55be4cea952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:37.273508 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-32b1810a-3949-4788-b8e9-d55be4cea952 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.116991 May 28 14:41:37.274135 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 786/1561] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:37 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:38.286012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-291b25a8-b1ea-4de5-a0ad-519551e68018 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:38.287011 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-291b25a8-b1ea-4de5-a0ad-519551e68018 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:38.295371 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-291b25a8-b1ea-4de5-a0ad-519551e68018 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:38.295859 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-291b25a8-b1ea-4de5-a0ad-519551e68018 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:38.296633 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-291b25a8-b1ea-4de5-a0ad-519551e68018 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:38.297074 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-291b25a8-b1ea-4de5-a0ad-519551e68018 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:38.396419 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-291b25a8-b1ea-4de5-a0ad-519551e68018 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.114499 May 28 14:41:38.397048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 776/1562] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:38 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:39.408800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7eef1e6e-fa0b-4dcb-af41-0ebc0b84b0cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:39.409806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7eef1e6e-fa0b-4dcb-af41-0ebc0b84b0cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:39.418561 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7eef1e6e-fa0b-4dcb-af41-0ebc0b84b0cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:39.419021 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7eef1e6e-fa0b-4dcb-af41-0ebc0b84b0cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:39.419859 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7eef1e6e-fa0b-4dcb-af41-0ebc0b84b0cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:39.420432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7eef1e6e-fa0b-4dcb-af41-0ebc0b84b0cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:39.513096 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7eef1e6e-fa0b-4dcb-af41-0ebc0b84b0cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.108368 May 28 14:41:39.513717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 787/1563] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:39 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:40.526139 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f1e440e0-2b2f-4753-ab7d-84ed30796de9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:40.527228 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f1e440e0-2b2f-4753-ab7d-84ed30796de9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:40.535991 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1e440e0-2b2f-4753-ab7d-84ed30796de9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:40.536441 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1e440e0-2b2f-4753-ab7d-84ed30796de9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:40.537222 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1e440e0-2b2f-4753-ab7d-84ed30796de9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:40.537657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f1e440e0-2b2f-4753-ab7d-84ed30796de9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:40.645038 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f1e440e0-2b2f-4753-ab7d-84ed30796de9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28238 microversion: 2.1 time: 0.122842 May 28 14:41:40.645731 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 777/1564] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:40 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28238 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:41.658146 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5b0daa31-020b-4aed-a680-bbc77a2624af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:41.659068 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5b0daa31-020b-4aed-a680-bbc77a2624af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:41.667005 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5b0daa31-020b-4aed-a680-bbc77a2624af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:41.667461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5b0daa31-020b-4aed-a680-bbc77a2624af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:41.668275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5b0daa31-020b-4aed-a680-bbc77a2624af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:41.668719 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5b0daa31-020b-4aed-a680-bbc77a2624af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:41.760181 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5b0daa31-020b-4aed-a680-bbc77a2624af tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28529 microversion: 2.1 time: 0.106538 May 28 14:41:41.760882 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 788/1565] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:41 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28529 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:42.773008 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-890ecefe-ece3-4bae-aea3-8f6ea2eff39d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:42.774005 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-890ecefe-ece3-4bae-aea3-8f6ea2eff39d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:42.782559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-890ecefe-ece3-4bae-aea3-8f6ea2eff39d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:42.792293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-890ecefe-ece3-4bae-aea3-8f6ea2eff39d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:42.792293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-890ecefe-ece3-4bae-aea3-8f6ea2eff39d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:42.792293 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-890ecefe-ece3-4bae-aea3-8f6ea2eff39d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:42.877808 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-890ecefe-ece3-4bae-aea3-8f6ea2eff39d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28529 microversion: 2.1 time: 0.108799 May 28 14:41:42.878465 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 778/1566] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:42 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28529 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:43.889948 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-3612005e-06fc-4393-8bec-127616edeff3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:43.890987 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-3612005e-06fc-4393-8bec-127616edeff3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:43.898850 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3612005e-06fc-4393-8bec-127616edeff3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:43.899304 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3612005e-06fc-4393-8bec-127616edeff3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:43.900114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3612005e-06fc-4393-8bec-127616edeff3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:43.900568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-3612005e-06fc-4393-8bec-127616edeff3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:43.995373 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-3612005e-06fc-4393-8bec-127616edeff3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.109433 May 28 14:41:43.995942 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 789/1567] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:43 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:45.007515 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-9a6e4335-00a7-46df-84a4-13c2f99bddfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:45.008574 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-9a6e4335-00a7-46df-84a4-13c2f99bddfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:45.016540 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a6e4335-00a7-46df-84a4-13c2f99bddfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:45.017003 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a6e4335-00a7-46df-84a4-13c2f99bddfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:45.017786 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a6e4335-00a7-46df-84a4-13c2f99bddfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:45.018232 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-9a6e4335-00a7-46df-84a4-13c2f99bddfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:45.111493 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-9a6e4335-00a7-46df-84a4-13c2f99bddfd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.107868 May 28 14:41:45.112099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 779/1568] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:45 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:46.123714 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fbe2fa27-aa5e-49d3-8c97-f0622b20ba44 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:46.124703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fbe2fa27-aa5e-49d3-8c97-f0622b20ba44 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:46.132586 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fbe2fa27-aa5e-49d3-8c97-f0622b20ba44 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:46.133049 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fbe2fa27-aa5e-49d3-8c97-f0622b20ba44 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:46.133835 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fbe2fa27-aa5e-49d3-8c97-f0622b20ba44 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:46.134279 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fbe2fa27-aa5e-49d3-8c97-f0622b20ba44 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:46.233129 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fbe2fa27-aa5e-49d3-8c97-f0622b20ba44 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.113997 May 28 14:41:46.233758 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 790/1569] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:46 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:47.245746 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-3d9bc1e6-c506-44d7-929b-50bc314db1f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:47.246788 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-3d9bc1e6-c506-44d7-929b-50bc314db1f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:47.254873 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3d9bc1e6-c506-44d7-929b-50bc314db1f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:47.255334 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3d9bc1e6-c506-44d7-929b-50bc314db1f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:47.256146 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3d9bc1e6-c506-44d7-929b-50bc314db1f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:47.256590 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-3d9bc1e6-c506-44d7-929b-50bc314db1f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:47.359205 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-3d9bc1e6-c506-44d7-929b-50bc314db1f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.117771 May 28 14:41:47.370483 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 780/1570] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:47 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:48.372737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-e42b080a-0758-4c20-8970-1bd9cb05125b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:48.373787 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-e42b080a-0758-4c20-8970-1bd9cb05125b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:48.381640 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e42b080a-0758-4c20-8970-1bd9cb05125b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:48.382100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e42b080a-0758-4c20-8970-1bd9cb05125b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:48.382879 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e42b080a-0758-4c20-8970-1bd9cb05125b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:48.383322 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-e42b080a-0758-4c20-8970-1bd9cb05125b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:48.479269 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-e42b080a-0758-4c20-8970-1bd9cb05125b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.110729 May 28 14:41:48.479965 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 791/1571] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:48 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:49.491657 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-cf909338-f892-4a0a-8b17-6e39030637d1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:49.492667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-cf909338-f892-4a0a-8b17-6e39030637d1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:49.501431 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cf909338-f892-4a0a-8b17-6e39030637d1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:49.501889 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cf909338-f892-4a0a-8b17-6e39030637d1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:49.502670 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cf909338-f892-4a0a-8b17-6e39030637d1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:49.503110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-cf909338-f892-4a0a-8b17-6e39030637d1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:49.597954 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-cf909338-f892-4a0a-8b17-6e39030637d1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.110384 May 28 14:41:49.598608 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 781/1572] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:49 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:50.610338 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2b27c5c5-b55a-492e-afe4-4f16f897a2d5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:50.611323 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2b27c5c5-b55a-492e-afe4-4f16f897a2d5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:50.619430 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2b27c5c5-b55a-492e-afe4-4f16f897a2d5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:50.619918 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2b27c5c5-b55a-492e-afe4-4f16f897a2d5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:50.620699 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2b27c5c5-b55a-492e-afe4-4f16f897a2d5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:50.621139 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2b27c5c5-b55a-492e-afe4-4f16f897a2d5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:50.720149 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2b27c5c5-b55a-492e-afe4-4f16f897a2d5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.114351 May 28 14:41:50.720782 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 792/1573] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:50 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:51.732154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5995a1c8-6df8-454c-815b-15321e7dcb79 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:51.733162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5995a1c8-6df8-454c-815b-15321e7dcb79 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:51.741747 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5995a1c8-6df8-454c-815b-15321e7dcb79 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:51.742203 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5995a1c8-6df8-454c-815b-15321e7dcb79 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:51.743258 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5995a1c8-6df8-454c-815b-15321e7dcb79 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:51.743732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5995a1c8-6df8-454c-815b-15321e7dcb79 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:51.845445 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5995a1c8-6df8-454c-815b-15321e7dcb79 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.117433 May 28 14:41:51.847528 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 782/1574] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:51 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:52.858060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-6dfb037e-efd2-4df1-a73e-b893d66e46c4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:52.859072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-6dfb037e-efd2-4df1-a73e-b893d66e46c4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:52.867290 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6dfb037e-efd2-4df1-a73e-b893d66e46c4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:52.867802 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6dfb037e-efd2-4df1-a73e-b893d66e46c4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:52.868855 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6dfb037e-efd2-4df1-a73e-b893d66e46c4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:52.869302 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-6dfb037e-efd2-4df1-a73e-b893d66e46c4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:52.963870 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-6dfb037e-efd2-4df1-a73e-b893d66e46c4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.110073 May 28 14:41:52.964491 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 793/1575] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:52 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:41:53.976725 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-29dad57a-a34c-4ea9-bdc8-36c2fe4f1e05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:53.977737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-29dad57a-a34c-4ea9-bdc8-36c2fe4f1e05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:53.985838 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-29dad57a-a34c-4ea9-bdc8-36c2fe4f1e05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:53.986298 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-29dad57a-a34c-4ea9-bdc8-36c2fe4f1e05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:53.987129 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-29dad57a-a34c-4ea9-bdc8-36c2fe4f1e05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:53.987598 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-29dad57a-a34c-4ea9-bdc8-36c2fe4f1e05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:54.084292 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-29dad57a-a34c-4ea9-bdc8-36c2fe4f1e05 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.111561 May 28 14:41:54.084837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 783/1576] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:53 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:55.096756 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-712cd8f8-4d7d-4a0f-8305-1ed526ff3d24 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:55.097655 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-712cd8f8-4d7d-4a0f-8305-1ed526ff3d24 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:55.105440 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-712cd8f8-4d7d-4a0f-8305-1ed526ff3d24 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:55.105890 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-712cd8f8-4d7d-4a0f-8305-1ed526ff3d24 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:55.106660 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-712cd8f8-4d7d-4a0f-8305-1ed526ff3d24 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:55.107099 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-712cd8f8-4d7d-4a0f-8305-1ed526ff3d24 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:55.205073 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-712cd8f8-4d7d-4a0f-8305-1ed526ff3d24 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.112366 May 28 14:41:55.205692 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 794/1577] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:55 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:56.216663 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-45f3c47a-cf45-4bd7-bfff-09ec312ed98d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:56.217714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-45f3c47a-cf45-4bd7-bfff-09ec312ed98d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:56.225646 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-45f3c47a-cf45-4bd7-bfff-09ec312ed98d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:56.226106 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-45f3c47a-cf45-4bd7-bfff-09ec312ed98d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:56.226891 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-45f3c47a-cf45-4bd7-bfff-09ec312ed98d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:56.227339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-45f3c47a-cf45-4bd7-bfff-09ec312ed98d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:56.324559 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-45f3c47a-cf45-4bd7-bfff-09ec312ed98d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.111909 May 28 14:41:56.325191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 784/1578] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:56 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:57.336530 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-7e2947ac-3253-4957-9e7d-76d6ba289cbc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:57.337532 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-7e2947ac-3253-4957-9e7d-76d6ba289cbc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:57.345406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e2947ac-3253-4957-9e7d-76d6ba289cbc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:57.345859 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e2947ac-3253-4957-9e7d-76d6ba289cbc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:57.346633 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e2947ac-3253-4957-9e7d-76d6ba289cbc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:57.347072 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-7e2947ac-3253-4957-9e7d-76d6ba289cbc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:57.439868 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-7e2947ac-3253-4957-9e7d-76d6ba289cbc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.107291 May 28 14:41:57.441190 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 795/1579] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:57 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:58.452625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-98beb6ab-4f11-4ac4-ad67-190db3b736f8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:58.453624 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-98beb6ab-4f11-4ac4-ad67-190db3b736f8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:58.461928 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98beb6ab-4f11-4ac4-ad67-190db3b736f8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:58.462376 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98beb6ab-4f11-4ac4-ad67-190db3b736f8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:58.463142 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98beb6ab-4f11-4ac4-ad67-190db3b736f8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:58.463592 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-98beb6ab-4f11-4ac4-ad67-190db3b736f8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:58.560468 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-98beb6ab-4f11-4ac4-ad67-190db3b736f8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.111842 May 28 14:41:58.561101 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 785/1580] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:58 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:41:59.572788 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-13c5dccd-dd38-4f47-8dfb-9148af85c219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:41:59.573806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-13c5dccd-dd38-4f47-8dfb-9148af85c219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:41:59.581702 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-13c5dccd-dd38-4f47-8dfb-9148af85c219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:59.582165 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-13c5dccd-dd38-4f47-8dfb-9148af85c219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:59.582954 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-13c5dccd-dd38-4f47-8dfb-9148af85c219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:41:59.583412 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-13c5dccd-dd38-4f47-8dfb-9148af85c219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:41:59.678717 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-13c5dccd-dd38-4f47-8dfb-9148af85c219 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.109822 May 28 14:41:59.679568 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 796/1581] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:41:59 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:42:00.691064 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-96506da5-1628-4f25-a1a2-b11065662855 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:00.692105 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-96506da5-1628-4f25-a1a2-b11065662855 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:00.700097 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-96506da5-1628-4f25-a1a2-b11065662855 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:00.700556 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-96506da5-1628-4f25-a1a2-b11065662855 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:00.701339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-96506da5-1628-4f25-a1a2-b11065662855 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:00.701898 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-96506da5-1628-4f25-a1a2-b11065662855 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:00.794224 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-96506da5-1628-4f25-a1a2-b11065662855 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.107314 May 28 14:42:00.794846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 786/1582] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:00 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:01.805731 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-f85682f4-d533-4bb9-a38c-f7dff63d2835 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:01.810480 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-f85682f4-d533-4bb9-a38c-f7dff63d2835 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:01.814893 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f85682f4-d533-4bb9-a38c-f7dff63d2835 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:01.815504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f85682f4-d533-4bb9-a38c-f7dff63d2835 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:01.825401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f85682f4-d533-4bb9-a38c-f7dff63d2835 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:01.825401 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-f85682f4-d533-4bb9-a38c-f7dff63d2835 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:01.912434 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-f85682f4-d533-4bb9-a38c-f7dff63d2835 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.110717 May 28 14:42:01.913076 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 797/1583] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:01 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:02.924685 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2f65c5d9-1861-4ba5-81c6-0ccf49d3bf06 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:02.925732 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2f65c5d9-1861-4ba5-81c6-0ccf49d3bf06 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:02.933695 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f65c5d9-1861-4ba5-81c6-0ccf49d3bf06 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:02.934156 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f65c5d9-1861-4ba5-81c6-0ccf49d3bf06 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:02.934940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f65c5d9-1861-4ba5-81c6-0ccf49d3bf06 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:02.935383 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f65c5d9-1861-4ba5-81c6-0ccf49d3bf06 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:03.031148 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2f65c5d9-1861-4ba5-81c6-0ccf49d3bf06 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.110464 May 28 14:42:03.031798 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 787/1584] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:02 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:42:04.042836 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-42f752b4-66aa-43a5-a9c2-d2f04c665023 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:04.043801 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-42f752b4-66aa-43a5-a9c2-d2f04c665023 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:04.051729 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-42f752b4-66aa-43a5-a9c2-d2f04c665023 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:04.052198 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-42f752b4-66aa-43a5-a9c2-d2f04c665023 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:04.052976 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-42f752b4-66aa-43a5-a9c2-d2f04c665023 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:04.053421 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-42f752b4-66aa-43a5-a9c2-d2f04c665023 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:04.145492 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-42f752b4-66aa-43a5-a9c2-d2f04c665023 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.106799 May 28 14:42:04.146115 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 798/1585] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:04 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:05.157251 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-eba7ad57-5c74-4be8-a78a-4d5b8d1a7396 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:05.158183 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-eba7ad57-5c74-4be8-a78a-4d5b8d1a7396 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:05.166458 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eba7ad57-5c74-4be8-a78a-4d5b8d1a7396 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:05.166917 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eba7ad57-5c74-4be8-a78a-4d5b8d1a7396 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:05.167714 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eba7ad57-5c74-4be8-a78a-4d5b8d1a7396 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:05.168153 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-eba7ad57-5c74-4be8-a78a-4d5b8d1a7396 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:05.406225 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-eba7ad57-5c74-4be8-a78a-4d5b8d1a7396 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.252955 May 28 14:42:05.406970 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 788/1586] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:05 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:06.419195 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-baf200e0-3a76-44a0-af33-8de3e8112214 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:06.420220 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-baf200e0-3a76-44a0-af33-8de3e8112214 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:06.428011 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-baf200e0-3a76-44a0-af33-8de3e8112214 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:06.428468 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-baf200e0-3a76-44a0-af33-8de3e8112214 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:06.429292 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-baf200e0-3a76-44a0-af33-8de3e8112214 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:06.429728 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-baf200e0-3a76-44a0-af33-8de3e8112214 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:06.522432 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-baf200e0-3a76-44a0-af33-8de3e8112214 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.107312 May 28 14:42:06.523806 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 799/1587] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:06 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:07.538976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d1d97c72-50b7-4fec-b120-f92d59db2df3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:07.540006 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-d1d97c72-50b7-4fec-b120-f92d59db2df3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:07.547924 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d1d97c72-50b7-4fec-b120-f92d59db2df3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:07.548381 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d1d97c72-50b7-4fec-b120-f92d59db2df3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:07.549162 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d1d97c72-50b7-4fec-b120-f92d59db2df3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:07.549600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-d1d97c72-50b7-4fec-b120-f92d59db2df3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:07.651380 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d1d97c72-50b7-4fec-b120-f92d59db2df3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.118163 May 28 14:42:07.651975 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 789/1588] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:07 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:08.663031 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-78819b42-6e5c-4294-b018-d1b70e108ece tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:08.664698 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-78819b42-6e5c-4294-b018-d1b70e108ece tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:08.672526 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-78819b42-6e5c-4294-b018-d1b70e108ece tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:08.672983 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-78819b42-6e5c-4294-b018-d1b70e108ece tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:08.673764 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-78819b42-6e5c-4294-b018-d1b70e108ece tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:08.674210 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-78819b42-6e5c-4294-b018-d1b70e108ece tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:08.770068 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-78819b42-6e5c-4294-b018-d1b70e108ece tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.111075 May 28 14:42:08.770707 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 800/1589] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:08 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:09.782948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-11edb84f-583e-4615-918b-2492e46bafc5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:09.783973 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-11edb84f-583e-4615-918b-2492e46bafc5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:09.792330 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-11edb84f-583e-4615-918b-2492e46bafc5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:09.792779 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-11edb84f-583e-4615-918b-2492e46bafc5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:09.793551 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-11edb84f-583e-4615-918b-2492e46bafc5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:09.793983 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-11edb84f-583e-4615-918b-2492e46bafc5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:09.896910 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-11edb84f-583e-4615-918b-2492e46bafc5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.117974 May 28 14:42:09.897531 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 790/1590] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:09 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 14:42:10.909156 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-397717ba-581c-4ec5-99b3-2d95463be875 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:10.910163 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-397717ba-581c-4ec5-99b3-2d95463be875 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:10.918688 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-397717ba-581c-4ec5-99b3-2d95463be875 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:10.919147 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-397717ba-581c-4ec5-99b3-2d95463be875 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:10.919971 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-397717ba-581c-4ec5-99b3-2d95463be875 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:10.920420 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-397717ba-581c-4ec5-99b3-2d95463be875 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:11.012603 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-397717ba-581c-4ec5-99b3-2d95463be875 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.107532 May 28 14:42:11.013223 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 801/1591] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:10 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:12.024781 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-32a362d0-30c2-4349-bceb-71511e33ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:12.025766 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-32a362d0-30c2-4349-bceb-71511e33ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:12.033600 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-32a362d0-30c2-4349-bceb-71511e33ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:12.034086 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-32a362d0-30c2-4349-bceb-71511e33ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:12.034857 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-32a362d0-30c2-4349-bceb-71511e33ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:12.035290 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-32a362d0-30c2-4349-bceb-71511e33ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:12.135686 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-32a362d0-30c2-4349-bceb-71511e33ad5b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 28697 microversion: 2.1 time: 0.114794 May 28 14:42:12.136226 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 791/1592] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:12 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 28697 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:13.147100 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-207f7b61-22ce-4244-8d1d-d1f861bc6012 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:13.148038 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-207f7b61-22ce-4244-8d1d-d1f861bc6012 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:13.155975 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-207f7b61-22ce-4244-8d1d-d1f861bc6012 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:13.156429 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-207f7b61-22ce-4244-8d1d-d1f861bc6012 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:13.157199 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-207f7b61-22ce-4244-8d1d-d1f861bc6012 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:13.157639 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-207f7b61-22ce-4244-8d1d-d1f861bc6012 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:13.250042 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-207f7b61-22ce-4244-8d1d-d1f861bc6012 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 29356 microversion: 2.1 time: 0.107001 May 28 14:42:13.250709 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 802/1593] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:13 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 29356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:14.262727 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ebb28711-7ed9-4388-b753-e38ef5979a1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:14.263759 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-ebb28711-7ed9-4388-b753-e38ef5979a1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:14.271708 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ebb28711-7ed9-4388-b753-e38ef5979a1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:14.272167 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ebb28711-7ed9-4388-b753-e38ef5979a1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:14.272941 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ebb28711-7ed9-4388-b753-e38ef5979a1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:14.273382 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-ebb28711-7ed9-4388-b753-e38ef5979a1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:14.373997 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ebb28711-7ed9-4388-b753-e38ef5979a1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 31549 microversion: 2.1 time: 0.115725 May 28 14:42:14.374623 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 792/1594] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:14 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 31549 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:15.386179 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-526ed684-f22f-4e84-b8c4-e7157f93a0d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:15.387193 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-526ed684-f22f-4e84-b8c4-e7157f93a0d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:15.395114 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-526ed684-f22f-4e84-b8c4-e7157f93a0d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:15.395596 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-526ed684-f22f-4e84-b8c4-e7157f93a0d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:15.396423 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-526ed684-f22f-4e84-b8c4-e7157f93a0d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:15.396870 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-526ed684-f22f-4e84-b8c4-e7157f93a0d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:15.494501 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-526ed684-f22f-4e84-b8c4-e7157f93a0d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 32964 microversion: 2.1 time: 0.112410 May 28 14:42:15.495128 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 803/1595] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:15 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 32964 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:16.506281 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2277572b-ea26-40d1-9fb2-b3c94d687e57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:16.507280 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2277572b-ea26-40d1-9fb2-b3c94d687e57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:16.515179 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2277572b-ea26-40d1-9fb2-b3c94d687e57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:16.515667 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2277572b-ea26-40d1-9fb2-b3c94d687e57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:16.516439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2277572b-ea26-40d1-9fb2-b3c94d687e57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:16.516876 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2277572b-ea26-40d1-9fb2-b3c94d687e57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:16.611975 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2277572b-ea26-40d1-9fb2-b3c94d687e57 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 33967 microversion: 2.1 time: 0.109732 May 28 14:42:16.612577 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 793/1596] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:16 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 33967 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:17.625046 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-5158baf3-4689-4bf0-aaf0-fd575a5a1479 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:17.626054 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-5158baf3-4689-4bf0-aaf0-fd575a5a1479 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:17.634297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5158baf3-4689-4bf0-aaf0-fd575a5a1479 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:17.635431 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5158baf3-4689-4bf0-aaf0-fd575a5a1479 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:17.636203 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5158baf3-4689-4bf0-aaf0-fd575a5a1479 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:17.636649 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-5158baf3-4689-4bf0-aaf0-fd575a5a1479 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:17.728864 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-5158baf3-4689-4bf0-aaf0-fd575a5a1479 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 35339 microversion: 2.1 time: 0.107914 May 28 14:42:17.729498 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 804/1597] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:17 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 35339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:18.741776 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-364023f5-9c1e-4f6a-b2bf-41a152e49c32 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:18.742777 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-364023f5-9c1e-4f6a-b2bf-41a152e49c32 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:18.751143 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-364023f5-9c1e-4f6a-b2bf-41a152e49c32 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:18.751619 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-364023f5-9c1e-4f6a-b2bf-41a152e49c32 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:18.752401 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-364023f5-9c1e-4f6a-b2bf-41a152e49c32 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:18.752837 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-364023f5-9c1e-4f6a-b2bf-41a152e49c32 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:18.846581 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-364023f5-9c1e-4f6a-b2bf-41a152e49c32 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 36898 microversion: 2.1 time: 0.108733 May 28 14:42:18.847524 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 794/1598] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:18 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 36898 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:19.859478 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-54045ce4-5a6c-4925-aca3-a3e646b66317 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:19.860500 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-54045ce4-5a6c-4925-aca3-a3e646b66317 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:19.868562 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-54045ce4-5a6c-4925-aca3-a3e646b66317 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:19.869060 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-54045ce4-5a6c-4925-aca3-a3e646b66317 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:19.869834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-54045ce4-5a6c-4925-aca3-a3e646b66317 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:19.870275 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-54045ce4-5a6c-4925-aca3-a3e646b66317 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:19.961381 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-54045ce4-5a6c-4925-aca3-a3e646b66317 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 38232 microversion: 2.1 time: 0.105865 May 28 14:42:19.962280 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 805/1599] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:19 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 38232 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:20.974621 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8df77876-790d-4418-a9a5-c184ea7829b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:20.975637 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8df77876-790d-4418-a9a5-c184ea7829b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:20.984284 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8df77876-790d-4418-a9a5-c184ea7829b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:20.984740 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8df77876-790d-4418-a9a5-c184ea7829b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:20.985512 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8df77876-790d-4418-a9a5-c184ea7829b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:20.985948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8df77876-790d-4418-a9a5-c184ea7829b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:21.082737 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8df77876-790d-4418-a9a5-c184ea7829b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 38232 microversion: 2.1 time: 0.111995 May 28 14:42:21.083321 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 795/1600] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:20 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 38232 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:22.095510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-1a292a9b-a45d-43d8-b700-9305672c8226 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:22.096458 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-1a292a9b-a45d-43d8-b700-9305672c8226 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:22.105093 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a292a9b-a45d-43d8-b700-9305672c8226 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:22.105543 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a292a9b-a45d-43d8-b700-9305672c8226 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:22.106327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a292a9b-a45d-43d8-b700-9305672c8226 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:22.106775 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-1a292a9b-a45d-43d8-b700-9305672c8226 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:22.206363 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-1a292a9b-a45d-43d8-b700-9305672c8226 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 38232 microversion: 2.1 time: 0.114964 May 28 14:42:22.207019 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 806/1601] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:22 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 38232 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:23.218808 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-4fcd539e-a395-4bd3-83e3-9ab937053271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:23.219847 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-4fcd539e-a395-4bd3-83e3-9ab937053271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:23.227875 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4fcd539e-a395-4bd3-83e3-9ab937053271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:23.233767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4fcd539e-a395-4bd3-83e3-9ab937053271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:23.233767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4fcd539e-a395-4bd3-83e3-9ab937053271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:23.233767 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-4fcd539e-a395-4bd3-83e3-9ab937053271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:23.328004 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-4fcd539e-a395-4bd3-83e3-9ab937053271 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 38232 microversion: 2.1 time: 0.113074 May 28 14:42:23.328677 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 796/1602] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:23 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 38232 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:24.341428 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-df6933e9-aecf-4222-bca8-756f960b3d1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:24.342466 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-df6933e9-aecf-4222-bca8-756f960b3d1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:24.350448 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-df6933e9-aecf-4222-bca8-756f960b3d1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:24.350908 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-df6933e9-aecf-4222-bca8-756f960b3d1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:24.351733 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-df6933e9-aecf-4222-bca8-756f960b3d1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:24.352178 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-df6933e9-aecf-4222-bca8-756f960b3d1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:24.464563 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-df6933e9-aecf-4222-bca8-756f960b3d1e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action" status: 200 len: 38363 microversion: 2.1 time: 0.127132 May 28 14:42:24.465253 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 807/1603] 10.222.0.59 () {60 vars in 1278 bytes} [Fri May 28 14:42:24 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/action => generated 38363 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 14:42:24.475571 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-fdcaf6d0-ad8e-4ada-a3cf-218514c1e230 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:24.476171 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-fdcaf6d0-ad8e-4ada-a3cf-218514c1e230 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:24.484749 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fdcaf6d0-ad8e-4ada-a3cf-218514c1e230 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:24.485211 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fdcaf6d0-ad8e-4ada-a3cf-218514c1e230 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:24.486028 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fdcaf6d0-ad8e-4ada-a3cf-218514c1e230 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:24.486475 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-fdcaf6d0-ad8e-4ada-a3cf-218514c1e230 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:24.543225 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-fdcaf6d0-ad8e-4ada-a3cf-218514c1e230 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/ips" status: 200 len: 143 microversion: 2.1 time: 0.071744 May 28 14:42:24.543849 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 797/1604] 10.222.0.59 () {58 vars in 1248 bytes} [Fri May 28 14:42:24 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/ips => generated 143 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:42:26.357485 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-96ca69fc-35c9-4931-9dbd-9615b05685b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e2bb66f-342b-45c8-bd0f-b620169a79fe"}} {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:26.360887 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-96ca69fc-35c9-4931-9dbd-9615b05685b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:26.366594 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-96ca69fc-35c9-4931-9dbd-9615b05685b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:26.367052 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-96ca69fc-35c9-4931-9dbd-9615b05685b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:26.367872 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-96ca69fc-35c9-4931-9dbd-9615b05685b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:26.368570 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-96ca69fc-35c9-4931-9dbd-9615b05685b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:27.432691 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-96ca69fc-35c9-4931-9dbd-9615b05685b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.079612 May 28 14:42:27.434040 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 808/1605] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:42:26 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments => generated 194 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:42:35.208461 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-8641e235-8416-4aad-b432-f839fa6e66cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:35.209391 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-8641e235-8416-4aad-b432-f839fa6e66cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:35.217716 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8641e235-8416-4aad-b432-f839fa6e66cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:35.218169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8641e235-8416-4aad-b432-f839fa6e66cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:35.218945 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8641e235-8416-4aad-b432-f839fa6e66cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:35.219383 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-8641e235-8416-4aad-b432-f839fa6e66cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:35.282752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-8641e235-8416-4aad-b432-f839fa6e66cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078083 May 28 14:42:35.283236 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 798/1606] 10.222.0.59 () {58 vars in 1302 bytes} [Fri May 28 14:42:35 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:42:35.293767 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-b79b0537-a71a-4b68-9062-2e513deb8605 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:35.294419 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-b79b0537-a71a-4b68-9062-2e513deb8605 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:35.305852 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b79b0537-a71a-4b68-9062-2e513deb8605 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:35.306346 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b79b0537-a71a-4b68-9062-2e513deb8605 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:35.307161 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b79b0537-a71a-4b68-9062-2e513deb8605 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:35.307700 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-b79b0537-a71a-4b68-9062-2e513deb8605 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:35.373504 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-b79b0537-a71a-4b68-9062-2e513deb8605 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/4e2bb66f-342b-45c8-bd0f-b620169a79fe" status: 200 len: 194 microversion: 2.1 time: 0.083499 May 28 14:42:35.374097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 809/1607] 10.222.0.59 () {58 vars in 1413 bytes} [Fri May 28 14:42:35 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/4e2bb66f-342b-45c8-bd0f-b620169a79fe => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:42:37.348434 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-15c25d59-c1cc-4bc8-99ae-478b27e9bb6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d895d33d-3c57-4ee1-a681-d48d35f7a847"}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:37.349489 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-15c25d59-c1cc-4bc8-99ae-478b27e9bb6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:37.357113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-15c25d59-c1cc-4bc8-99ae-478b27e9bb6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:37.357567 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-15c25d59-c1cc-4bc8-99ae-478b27e9bb6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:37.358866 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-15c25d59-c1cc-4bc8-99ae-478b27e9bb6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:37.359316 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-15c25d59-c1cc-4bc8-99ae-478b27e9bb6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:38.221846 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-15c25d59-c1cc-4bc8-99ae-478b27e9bb6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.876979 May 28 14:42:38.222506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 799/1608] 10.222.0.59 () {60 vars in 1323 bytes} [Fri May 28 14:42:37 2021] POST /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:42:46.017921 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-38703856-14c9-4d49-9bff-e2186fe64c16 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:46.024938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-38703856-14c9-4d49-9bff-e2186fe64c16 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:46.026875 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-38703856-14c9-4d49-9bff-e2186fe64c16 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:46.027334 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-38703856-14c9-4d49-9bff-e2186fe64c16 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:46.028404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-38703856-14c9-4d49-9bff-e2186fe64c16 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:46.028648 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-38703856-14c9-4d49-9bff-e2186fe64c16 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:46.099461 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-38703856-14c9-4d49-9bff-e2186fe64c16 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.086156 May 28 14:42:46.100291 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 810/1609] 10.222.0.59 () {58 vars in 1302 bytes} [Fri May 28 14:42:46 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:42:46.335405 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2f3ef7b9-6c06-48f9-833d-bd2d4dffcf70 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:46.336050 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2f3ef7b9-6c06-48f9-833d-bd2d4dffcf70 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:46.344338 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7b9-6c06-48f9-833d-bd2d4dffcf70 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:46.344800 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7b9-6c06-48f9-833d-bd2d4dffcf70 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:46.345625 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7b9-6c06-48f9-833d-bd2d4dffcf70 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:46.346077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7b9-6c06-48f9-833d-bd2d4dffcf70 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:46.411896 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2f3ef7b9-6c06-48f9-833d-bd2d4dffcf70 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/4e2bb66f-342b-45c8-bd0f-b620169a79fe" status: 200 len: 194 microversion: 2.1 time: 0.081276 May 28 14:42:46.412487 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 800/1610] 10.222.0.59 () {58 vars in 1413 bytes} [Fri May 28 14:42:46 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/4e2bb66f-342b-45c8-bd0f-b620169a79fe => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:42:46.422465 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4e609193-bce9-4528-bb6c-db06318d9878 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:46.422974 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-4e609193-bce9-4528-bb6c-db06318d9878 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:46.430242 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e609193-bce9-4528-bb6c-db06318d9878 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:46.430703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e609193-bce9-4528-bb6c-db06318d9878 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:46.431484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e609193-bce9-4528-bb6c-db06318d9878 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:46.431964 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-4e609193-bce9-4528-bb6c-db06318d9878 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:46.589287 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-4e609193-bce9-4528-bb6c-db06318d9878 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lazy-loading 'services' on Instance uuid 08dfb653-07bf-461d-bd53-3f1346a89bb9 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:42:46.904286 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4e609193-bce9-4528-bb6c-db06318d9878 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/4e2bb66f-342b-45c8-bd0f-b620169a79fe" status: 202 len: 0 microversion: 2.1 time: 0.485473 May 28 14:42:46.905098 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 811/1611] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:42:46 2021] DELETE /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/4e2bb66f-342b-45c8-bd0f-b620169a79fe => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:42:49.213012 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-5612f24d-70d8-411e-8d9a-0c662603ce6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:49.213526 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-5612f24d-70d8-411e-8d9a-0c662603ce6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:49.221765 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5612f24d-70d8-411e-8d9a-0c662603ce6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:49.222217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5612f24d-70d8-411e-8d9a-0c662603ce6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:49.222981 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5612f24d-70d8-411e-8d9a-0c662603ce6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:49.223415 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-5612f24d-70d8-411e-8d9a-0c662603ce6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:49.288782 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-5612f24d-70d8-411e-8d9a-0c662603ce6e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/d895d33d-3c57-4ee1-a681-d48d35f7a847" status: 200 len: 194 microversion: 2.1 time: 0.079524 May 28 14:42:49.289360 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 801/1612] 10.222.0.59 () {58 vars in 1413 bytes} [Fri May 28 14:42:49 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/d895d33d-3c57-4ee1-a681-d48d35f7a847 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:42:49.299790 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-30be4497-e72f-4bfc-828f-ae5ef9dc7596 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:49.300387 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-30be4497-e72f-4bfc-828f-ae5ef9dc7596 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:49.307832 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30be4497-e72f-4bfc-828f-ae5ef9dc7596 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:49.308297 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30be4497-e72f-4bfc-828f-ae5ef9dc7596 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:49.309079 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30be4497-e72f-4bfc-828f-ae5ef9dc7596 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:49.309527 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-30be4497-e72f-4bfc-828f-ae5ef9dc7596 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:49.471412 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.objects.instance [None req-30be4497-e72f-4bfc-828f-ae5ef9dc7596 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lazy-loading 'services' on Instance uuid 08dfb653-07bf-461d-bd53-3f1346a89bb9 {{(pid=106811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:42:49.771213 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-30be4497-e72f-4bfc-828f-ae5ef9dc7596 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/d895d33d-3c57-4ee1-a681-d48d35f7a847" status: 202 len: 0 microversion: 2.1 time: 0.475584 May 28 14:42:49.772145 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 812/1613] 10.222.0.59 () {58 vars in 1416 bytes} [Fri May 28 14:42:49 2021] DELETE /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9/os-volume_attachments/d895d33d-3c57-4ee1-a681-d48d35f7a847 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 14:42:51.325154 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:51.325696 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:51.333378 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:51.333834 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:51.334606 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:51.335042 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:51.394960 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Going to try to terminate instance {{(pid=106812) delete /opt/stack/nova/nova/compute/api.py:2539}} May 28 14:42:51.696710 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 204 len: 0 microversion: 2.1 time: 0.375009 May 28 14:42:51.697217 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 802/1614] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:42:51 2021] DELETE /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 14:42:51.705883 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:51.706703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:51.714800 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:51.719437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:51.719437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:51.719437 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:51.911510 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:42:51.919825 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1672 microversion: 2.1 time: 0.218166 May 28 14:42:51.920404 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 813/1615] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:42:51 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:42:52.938227 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-a6985fb1-3706-4ca3-9730-489a501c4904 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:52.938936 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-a6985fb1-3706-4ca3-9730-489a501c4904 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:52.946318 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6985fb1-3706-4ca3-9730-489a501c4904 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:52.946778 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6985fb1-3706-4ca3-9730-489a501c4904 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:52.947612 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6985fb1-3706-4ca3-9730-489a501c4904 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:52.948057 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-a6985fb1-3706-4ca3-9730-489a501c4904 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:53.146757 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.policy [None req-a6985fb1-3706-4ca3-9730-489a501c4904 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106812) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:42:53.155073 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-a6985fb1-3706-4ca3-9730-489a501c4904 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1672 microversion: 2.1 time: 0.221669 May 28 14:42:53.155658 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 803/1616] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:42:52 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:42:54.171502 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:54.172144 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:54.179639 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:54.180096 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:54.180880 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:54.181327 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:54.662007 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:42:54.670134 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1672 microversion: 2.1 time: 0.502413 May 28 14:42:54.670772 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 814/1617] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:42:54 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1672 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 14:42:55.653068 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [req-ff8c72a4-edac-4477-821d-f3f61acae5eb req-71e202cf-191b-4281-abe3-80298b6aa769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dfb653-07bf-461d-bd53-3f1346a89bb9", "name": "network-vif-deleted", "tag": "10309ae3-44cf-4796-91db-63f78b0c6d94"}]} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:42:55.654653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 14:42:55.654653 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: warnings.warn(msg) May 28 14:42:55.665133 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-ff8c72a4-edac-4477-821d-f3f61acae5eb req-71e202cf-191b-4281-abe3-80298b6aa769 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:55.665585 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [req-ff8c72a4-edac-4477-821d-f3f61acae5eb req-71e202cf-191b-4281-abe3-80298b6aa769 service nova] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:55.681929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.compute.server_external_events [req-ff8c72a4-edac-4477-821d-f3f61acae5eb req-71e202cf-191b-4281-abe3-80298b6aa769 service nova] Creating event network-vif-deleted:10309ae3-44cf-4796-91db-63f78b0c6d94 for instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 on hv-cinder-79128 May 28 14:42:55.687960 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-d9d808b3-ad85-4189-8f71-e5190a1fe52c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:55.688534 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [req-ff8c72a4-edac-4477-821d-f3f61acae5eb req-71e202cf-191b-4281-abe3-80298b6aa769 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090064 May 28 14:42:55.688726 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-d9d808b3-ad85-4189-8f71-e5190a1fe52c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:55.689169 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 804/1618] 10.222.0.59 () {64 vars in 1318 bytes} [Fri May 28 14:42:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:42:55.697224 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9d808b3-ad85-4189-8f71-e5190a1fe52c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:55.697763 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9d808b3-ad85-4189-8f71-e5190a1fe52c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:55.698786 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9d808b3-ad85-4189-8f71-e5190a1fe52c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:55.699300 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-d9d808b3-ad85-4189-8f71-e5190a1fe52c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:55.882406 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.policy [None req-d9d808b3-ad85-4189-8f71-e5190a1fe52c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4e743e57e44cd78fe2e68ea8d97eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=106811) authorize /opt/stack/nova/nova/policy.py:199}} May 28 14:42:55.894019 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-d9d808b3-ad85-4189-8f71-e5190a1fe52c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 200 len: 1604 microversion: 2.1 time: 0.210351 May 28 14:42:55.894824 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 815/1619] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:42:55 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 14:42:56.913103 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:56.914469 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:42:56.921959 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:56.922402 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:56.923191 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:56.923671 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:56.972930 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] HTTP exception thrown: Instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 could not be found. May 28 14:42:56.973545 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Returning 404 to user: Instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:42:56.974461 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-f0d36751-af18-443e-be65-1245a9201bfc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 404 len: 111 microversion: 2.1 time: 0.065616 May 28 14:42:56.974976 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 805/1620] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:42:56 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 14:42:56.989820 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-4ca3aab3-178d-4e39-911b-38d059b3cb9b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '.version_select at 0x7f2aadc81160>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:42:57.069834 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-4ca3aab3-178d-4e39-911b-38d059b3cb9b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400425300" status: 202 len: 0 microversion: 2.1 time: 0.083743 May 28 14:42:57.070439 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 816/1621] 10.222.0.59 () {58 vars in 1221 bytes} [Fri May 28 14:42:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400425300 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:43:01.016929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:01.017439 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:43:01.024613 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:01.025077 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:01.025851 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:01.026295 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:01.076110 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] HTTP exception thrown: Instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 could not be found. May 28 14:43:01.076636 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Returning 404 to user: Instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:43:01.077506 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-2aa8f53f-bc82-4ca8-a91e-f4d55545e264 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 404 len: 111 microversion: 2.1 time: 0.064394 May 28 14:43:01.078063 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 806/1622] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:43:01 2021] DELETE /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:43:01.086465 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:01.087094 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 08dfb653-07bf-461d-bd53-3f1346a89bb9] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:43:01.095020 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:01.095484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:01.096652 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:01.096789 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:01.149426 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] HTTP exception thrown: Instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 could not be found. May 28 14:43:01.150045 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Returning 404 to user: Instance 08dfb653-07bf-461d-bd53-3f1346a89bb9 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:43:01.150920 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-69f8c0ca-afc9-4be9-88dd-a348dcf0d710 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9" status: 404 len: 111 microversion: 2.1 time: 0.068810 May 28 14:43:01.151473 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 817/1623] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:43:01 2021] GET /compute/v2.1/servers/08dfb653-07bf-461d-bd53-3f1346a89bb9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:43:02.535473 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:02.536016 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.compute.api [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106812) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:43:02.543437 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:02.543940 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:02.544752 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:02.545188 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG oslo_concurrency.lockutils [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:02.597513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] HTTP exception thrown: Instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 could not be found. May 28 14:43:02.598113 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Returning 404 to user: Instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:43:02.598948 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-715ddb53-5981-4308-9885-e517661a2ba6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 404 len: 111 microversion: 2.1 time: 0.068298 May 28 14:43:02.599513 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 807/1624] 10.222.0.59 () {58 vars in 1239 bytes} [Fri May 28 14:43:02 2021] DELETE /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:43:02.610978 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling method '>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:02.611799 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.compute.api [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] [instance: 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46] Fetching instance by UUID {{(pid=106811) get /opt/stack/nova/nova/compute/api.py:2790}} May 28 14:43:02.619397 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:02.619894 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:02.620701 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:02.621145 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG oslo_concurrency.lockutils [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "af7bb5ca-612d-46a1-a71f-5077f87c311e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:02.671737 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.wsgi [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] HTTP exception thrown: Instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 could not be found. May 28 14:43:02.672367 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Returning 404 to user: Instance 5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 could not be found. {{(pid=106811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:43:02.673228 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-490b0b09-6389-4ffd-a48a-6727325c585a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46" status: 404 len: 111 microversion: 2.1 time: 0.066736 May 28 14:43:02.673792 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 818/1625] 10.222.0.59 () {58 vars in 1236 bytes} [Fri May 28 14:43:02 2021] GET /compute/v2.1/servers/5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:43:10.528524 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d4660e82-e16a-4b96-93af-021105fec199 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] Action: 'create', calling method: .version_select at 0x7f2aad0318b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1635152062", "metadata": {"Type": "work"}}} {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 14:43:11.326301 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d4660e82-e16a-4b96-93af-021105fec199 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.915658 May 28 14:43:11.326929 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 808/1626] 10.222.0.59 () {60 vars in 1156 bytes} [Fri May 28 14:43:10 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 917 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 28 14:43:11.338410 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-0db552a9-ca7c-4cb3-8a86-ba0e3cd7ba22 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] Calling method '.version_select at 0x7f2aae5049d0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:11.432376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-0db552a9-ca7c-4cb3-8a86-ba0e3cd7ba22 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d" status: 200 len: 353 microversion: 2.1 time: 0.095661 May 28 14:43:11.432376 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 819/1627] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:43:11 2021] GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:43:12.443339 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-73dadfef-df06-43a4-89e2-795516a98bb0 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] Calling method '.version_select at 0x7f2aad277f70>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:12.533446 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-73dadfef-df06-43a4-89e2-795516a98bb0 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d" status: 200 len: 354 microversion: 2.1 time: 0.093785 May 28 14:43:12.534048 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 809/1628] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:43:12 2021] GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 14:43:12.544703 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-54b2bd78-ba12-4e49-92b1-48f5e5cb5d12 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] Calling method '.version_select at 0x7f2aaee173a0>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:12.634921 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-54b2bd78-ba12-4e49-92b1-48f5e5cb5d12 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d" status: 200 len: 354 microversion: 2.1 time: 0.093875 May 28 14:43:12.635529 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 820/1629] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:43:12 2021] GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:43:12.650875 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-d0262a19-1258-4d91-9abb-4198ebc16c70 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] Calling method '.version_select at 0x7f2aad277310>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:12.919238 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-d0262a19-1258-4d91-9abb-4198ebc16c70 tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d" status: 202 len: 0 microversion: 2.1 time: 0.271917 May 28 14:43:12.920019 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 810/1630] 10.222.0.59 () {58 vars in 1248 bytes} [Fri May 28 14:43:12 2021] DELETE /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 14:43:12.928307 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: DEBUG nova.api.openstack.wsgi [None req-8ccf083c-2732-4dc9-89a5-1d904439d26d tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] Calling method '.version_select at 0x7f2aaed89940>' {{(pid=106811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:13.023097 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO nova.api.openstack.requestlog [None req-8ccf083c-2732-4dc9-89a5-1d904439d26d tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d" status: 200 len: 353 microversion: 2.1 time: 0.098409 May 28 14:43:13.023697 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: [pid: 106811|app: 0|req: 821/1631] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:43:12 2021] GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 14:43:14.035471 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ef819849-0a23-43cc-bf4c-cb30e4fae8fb tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] Calling method '.version_select at 0x7f2aad2773a0>' {{(pid=106812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 14:43:14.093715 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.wsgi [None req-ef819849-0a23-43cc-bf4c-cb30e4fae8fb tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] HTTP exception thrown: Volume 35f59a19-2575-49bf-b488-5d889b5ef95d could not be found. May 28 14:43:14.094989 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: DEBUG nova.api.openstack.wsgi [None req-ef819849-0a23-43cc-bf4c-cb30e4fae8fb tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] Returning 404 to user: Volume 35f59a19-2575-49bf-b488-5d889b5ef95d could not be found. {{(pid=106812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 28 14:43:14.095923 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO nova.api.openstack.requestlog [None req-ef819849-0a23-43cc-bf4c-cb30e4fae8fb tempest-VolumesGetTestJSON-699722350 tempest-VolumesGetTestJSON-699722350-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d" status: 404 len: 109 microversion: 2.1 time: 0.064701 May 28 14:43:14.096472 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: [pid: 106812|app: 0|req: 811/1632] 10.222.0.59 () {58 vars in 1245 bytes} [Fri May 28 14:43:14 2021] GET /compute/v2.1/os-volumes/35f59a19-2575-49bf-b488-5d889b5ef95d => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 14:44:32.972349 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:44:32.973099 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:44:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:45:58.097484 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:45:58.098078 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: Fri May 28 14:45:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:46:18.950525 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:46:18.951046 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:46:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:46:24.026194 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:46:24.026706 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: Fri May 28 14:46:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:47:52.990328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:47:52.990328 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:47:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:48:12.430329 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:48:12.430938 dv-cinder-791281-3-iscsi devstack@n-api.service[106811]: Fri May 28 14:48:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 14:48:27.256993 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:48:27.257611 dv-cinder-791281-3-iscsi devstack@n-api.service[106812]: Fri May 28 14:48:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!